00000001:02000400:3.0F:1788725767.160540:0:2961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788725786.705551:0:3181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788725788.459855:0:3221:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1023 MB/s 00000001:01000000:0.0:1788725788.709378:0:3221:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1059 MB/s 00000001:01000000:0.0:1788725788.959321:0:3221:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2851 MB/s 00000020:02000000:3.0:1788725790.021453:0:3273:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_g794a134 00000400:02000000:1.0F:1788725791.336023:0:3288:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.142@tcp [8/256/0/180] 00008000:02000000:3.0:1788725794.557206:0:3438:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788725853.674692:0:5241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing load_modules_local 00000020:01000004:2.0F:1788725865.322394:0:5814:0:(obd_mount.c:934:lmd_print()) mount data: 00000020:01000004:2.0:1788725865.322402:0:5814:0:(obd_mount.c:937:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788725865.322494:0:5814:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000189d8b26 00000080:02000400:2.0:1788725865.322506:0:5814:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788725865.336818:0:5814:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788725865.336840:0:5814:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788725865.337159:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b41fd35c) 00000020:00000080:2.0:1788725865.337191:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788725865.387703:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788725865.388174:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788725865.450791:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788725865.450836:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788725865.450858:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788725865.450913:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788725865.450941:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788725865.451430:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788725865.451440:0:5814:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788725865.451453:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbde9110e47c0d87 00000020:01000004:0.0:1788725865.451463:0:5814:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788725865.451469:0:5814:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788725865.451474:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000189d8b26 from MGS 00000020:01000004:0.0:1788725865.451480:0:5814:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788725865.451501:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000e52428a6) 00000020:00000080:0.0:1788725865.451515:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788725865.470246:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000189d8b26 from MGS, refs=2 00080000:01000000:0.0:1788725865.470272:0:5814:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788725865.470289:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbde9110e47c0d95 00000100:00100000:0.0:1788725865.470462:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788725865.478362:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788725865.478382:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788725865.482255:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788725865.482273:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788725865.484039:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788725865.484338:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788725865.484345:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788725865.489447:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788725865.489474:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788725865.491137:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788725865.491154:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788725865.509701:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725865.509709:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725865.509712:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725865.510312:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725865.510317:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725865.510319:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725865.511183:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788725865.517275:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788725865.760833:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1479 MB/s 00000001:01000000:3.0:1788725866.010286:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1779 MB/s 00000001:01000000:3.0:1788725866.261774:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 322 MB/s 00000001:01000000:3.0:1788725866.517353:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 492 MB/s 00010000:00010000:0.0:1788725866.517538:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788725866.536261:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1788725866.567852:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788725866.567892:0:5814:0:(mgs_llog.c:153:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788725866.567895:0:5814:0:(mgs_llog.c:153:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788725866.570846:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788725866.570937:0:5814:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788725866.571000:0:5814:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788725866.571592:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788725866.571628:0:5814:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788725866.572001:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788725866.572192:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788725866.572199:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788725866.590013:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788725866.590028:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788725866.599504:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788725866.599528:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1788725866.600175:0:5830:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788725866.600310:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788725866.600336:0:5814:0:(obd_mount.c:422:lustre_start_mgc()) Start MGC 'MGC192.168.201.142@tcp' 00000020:01000004:2.0:1788725866.600337:0:5814:0:(obd_mount.c:431:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788725866.600398:0:5814:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD MGC192.168.201.142@tcp (typ=mgc) 00000020:00000080:2.0:1788725866.600412:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.142@tcp (0000000015c2589d) 00000020:00000080:2.0:1788725866.600432:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788725866.600537:0:5814:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008fdeeb8c@MGC192.168.201.142@tcp: add connection 192.168.201.142@tcp at head 00010000:00010000:2.0:1788725866.600715:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.142@tcp-0 is initialized 00000040:01000000:2.0:1788725866.600722:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788725866.608299:0:5831:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788725866.611825:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.142@tcp (uuid 8c72aebd-b8cf-4cbb-9509-e828aebfedcb) 00000020:00000080:3.0:1788725866.611856:0:5814:0:(genops.c:1385:class_connect()) connect: client 8c72aebd-b8cf-4cbb-9509-e828aebfedcb, cookie 0xcbde9110e47c0da3 00000100:00080000:3.0:1788725866.611869:0:5814:0:(import.c:510:import_select_connection()) MGC192.168.201.142@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788725866.611874:0:5814:0:(import.c:624:import_select_connection()) MGC192.168.201.142@tcp: import 000000008fdeeb8c using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788725866.611922:0:5814:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000073685fb1 x1875614935023744/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788725866.611940:0:5814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8c72aebd-b8cf-4cbb-9509-e828aebfedcb->MGS 00000020:01000004:3.0:1788725866.611957:0:5814:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788725866.611962:0:5814:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788725866.611982:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000dab6ad5a) 00000020:00000080:3.0:1788725866.611995:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788725866.614117:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073685fb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3303:1875614935023744:0@lo:250: 00000100:00100000:1.0:1788725866.614194:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725866.614511:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935023744 00000100:00100000:0.0:1788725866.614531:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935023744 00000100:00100000:0.0:1788725866.614574:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788725866.614583:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d89e564 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1875614935023744:12345-0@lo:250: 00010000:00080000:0.0:1788725866.614623:0:5827:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8c72aebd-b8cf-4cbb-9509-e828aebfedcb@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:0.0:1788725866.614651:0:5827:0:(genops.c:1385:class_connect()) connect: client 8c72aebd-b8cf-4cbb-9509-e828aebfedcb, cookie 0xcbde9110e47c0db1 00000100:00080000:0.0:1788725866.614791:0:5827:0:(import.c:65:import_set_state_nolock()) 0000000030205ae2 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788725866.614854:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d89e564 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+5:3303:x1875614935023744:12345-0@lo:250: Request processed in 271us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725866.614862:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788725866.614903:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.142@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788725866.614912:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.142@tcp: connect to target with instance 0 00000100:00080000:0.0:1788725866.614921:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.142@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788725866.614927:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788725866.614930:0:3303:0:(import.c:65:import_set_state_nolock()) 000000008fdeeb8c MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788725866.614933:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788725866.614941:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788725866.614947:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073685fb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3303:1875614935023744:0@lo:250: 00000100:00100000:0.0:1788725866.643451:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788725866.643674:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788725866.643681:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788725866.654509:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788725866.654613:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788725866.663148:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788725866.663164:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788725866.671589:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788725866.671786:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788725866.671800:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788725866.675174:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788725866.675585:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788725866.719344:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788725866.719597:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788725866.719604:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788725866.720752:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788725866.720761:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788725866.721569:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788725866.721747:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788725866.721752:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788725866.722393:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788725866.722400:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788725866.722985:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788725866.723510:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788725866.723528:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788725866.724020:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788725866.724033:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788725866.724768:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788725866.724938:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788725866.724943:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788725866.728593:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788725866.728608:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788725866.753998:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788725866.754367:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788725866.754375:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788725866.759958:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788725866.759975:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788725866.760764:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788725866.760773:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788725866.763241:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788725866.763274:0:5814:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788725866.763280:0:5814:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788725866.763418:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788725866.763463:0:5814:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.142@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788725866.763467:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788725866.763469:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788725866.763471:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788725866.763472:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788725866.763473:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788725866.763475:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788725866.763476:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788725866.763478:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788725866.763479:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788725866.763480:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788725866.763481:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788725866.763483:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788725866.763485:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788725866.763487:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788725866.763488:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788725866.763489:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788725866.763491:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788725866.763492:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788725866.763493:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788725866.763494:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788725866.763495:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788725866.763496:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788725866.763500:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788725866.763501:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788725866.763502:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788725866.763551:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788725866.763570:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006719724c pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935023872:0@lo:253: 00000100:00100000:1.0:1788725866.763650:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725866.763700:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e9617c65 going to sleep for 11 seconds 00000100:00100000:0.0:1788725866.764195:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935023872 00000100:00100000:0.0:1788725866.764204:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935023872 00000100:00100000:0.0:1788725866.764293:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788725866.764302:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9d9e085 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+5:5814:x1875614935023872:12345-0@lo:253: 20000000:01000000:0.0:1788725866.764353:0:5829:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788725866.764355:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788725866.765104:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788725866.765252:0:5829:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788725866.765533:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788725866.766580:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788725866.766893:0:5829:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788725866.766897:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788725866.766904:0:5829:0:(mgs_llog.c:872:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788725866.766907:0:5829:0:(mgs_llog.c:3615:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788725866.766921:0:5829:0:(mgs_llog.c:3175:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788725866.767341:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788725866.767625:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788725866.767641:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788725866.767691:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788725866.767738:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788725866.767779:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788725866.767876:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788725866.767885:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788725866.767933:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788725866.767942:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788725866.767972:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788725866.767979:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788725866.768008:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788725866.768074:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788725866.770268:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788725866.770278:0:5829:0:(mgs_llog.c:3175:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788725866.770294:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788725866.770579:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788725866.770593:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788725866.770639:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788725866.770673:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788725866.770731:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788725866.770743:0:5829:0:(mgs_llog.c:3132:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788725866.770819:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788725866.770828:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788725866.770874:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788725866.770912:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788725866.770952:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788725866.770962:0:5829:0:(mgs_llog.c:3097:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788725866.771042:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788725866.771051:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788725866.771083:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788725866.771114:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788725866.771307:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788725866.771358:0:5829:0:(mgs_llog.c:3312:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788725866.771372:0:5829:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788725866.775782:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788725866.776177:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788725866.776205:0:5829:0:(mgs_llog.c:3358:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.142@tcp for mdt 20000000:01000000:0.0:1788725866.776207:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf005 192.168.201.142@tcp (null) (null) (null) 00000040:00080000:0.0:1788725866.776270:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788725866.776279:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788725866.776310:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788725866.776317:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.142@tcp (null) (null) 00000040:00080000:0.0:1788725866.776361:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788725866.776370:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788725866.776427:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788725866.776461:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788725866.776533:0:5829:0:(mgs_llog.c:5255:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788725866.776536:0:5829:0:(mgs_llog.c:4751:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788725866.776540:0:5829:0:(mgs_llog.c:4184:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788725866.776551:0:5829:0:(mgs_llog.c:153:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788725866.776553:0:5829:0:(mgs_llog.c:153:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788725866.776591:0:5829:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788725866.776593:0:5829:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788725866.777431:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788725866.777680:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788725866.777718:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788725866.777782:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1788725866.777795:0:5829:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788725866.777797:0:5829:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788725866.779358:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788725866.779706:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788725866.779751:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788725866.779789:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788725866.779803:0:5829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788725866.779806:0:5829:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788725866.779811:0:5829:0:(mgs_llog.c:5255:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788725866.779814:0:5829:0:(mgs_llog.c:4751:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788725866.779819:0:5829:0:(mgs_llog.c:5075:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788725866.779825:0:5829:0:(mgs_llog.c:1382:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788725866.782880:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788725866.783045:0:5829:0:(mgs_llog.c:4123:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788725866.794511:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788725866.794904:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788725866.795006:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788725866.795032:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788725866.795062:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007699bc0d/0xcbde9110e47c0db8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725866.795084:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007699bc0d/0xcbde9110e47c0db8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725866.795095:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007699bc0d/0xcbde9110e47c0db8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725866.795102:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007699bc0d/0xcbde9110e47c0db8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725866.795127:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007699bc0d/0xcbde9110e47c0db8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725866.795134:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007699bc0d/0xcbde9110e47c0db8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725866.795141:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007699bc0d already unused, calling callback (000000004c776cbe) 00010000:00010000:0.0:1788725866.795145:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007699bc0d/0xcbde9110e47c0db8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725866.795154:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007699bc0d/0xcbde9110e47c0db8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725866.795167:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007699bc0d/0xcbde9110e47c0db8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725866.795176:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007699bc0d/0xcbde9110e47c0db8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725866.795181:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007699bc0d/0xcbde9110e47c0db8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788725866.795910:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788725867.312054:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9d9e085 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+5:5814:x1875614935023872:12345-0@lo:253: Request processed in 547746us (548396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725867.312180:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788725867.312377:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006719724c pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935023872:0@lo:253: 10000000:01000000:2.0:1788725867.312395:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788725867.312405:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788725867.312407:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788725867.312408:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788725867.312409:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788725867.312411:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788725867.312412:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788725867.312414:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788725867.312415:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788725867.312416:0:5814:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788725867.312418:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788725867.312419:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788725867.312441:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000189d8b26 from lustre-MDT0000 10000000:01000000:2.0:1788725867.312466:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788725867.312469:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788725867.312475:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91a103273370 10000000:01000000:2.0:1788725867.312481:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788725867.312489:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91a103273370 from 1 10000000:01000000:2.0:1788725867.312492:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788725867.312571:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: 000000000182c38b/0xcbde9110e47c0dbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725867.312583:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: 000000000182c38b/0xcbde9110e47c0dbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725867.312593:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: 000000000182c38b/0xcbde9110e47c0dbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725867.312613:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f1b8f810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935024000:0@lo:101: 00000100:00100000:2.0:1788725867.312665:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725867.312811:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935024000 00000100:00100000:0.0:1788725867.312820:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935024000 00000100:00100000:0.0:1788725867.312872:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788725867.312882:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b387d18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+5:5814:x1875614935024000:12345-0@lo:101: 00010000:00010000:0.0:1788725867.312896:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725867.312910:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007699bc0d/0xcbde9110e47c0dc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0dbf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725867.312944:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007699bc0d/0xcbde9110e47c0dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0dbf expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725867.312954:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007699bc0d/0xcbde9110e47c0dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0dbf expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725867.312966:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007699bc0d, rc 0) 00000100:00100000:0.0:1788725867.312995:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b387d18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+6:5814:x1875614935024000:12345-0@lo:101: Request processed in 116us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725867.313002:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788725867.313065:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000004ae3878e going to sleep for 11 seconds 00000100:00100000:2.0:1788725867.313205:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f1b8f810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935024000:0@lo:101: 00010000:00010000:2.0:1788725867.313239:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: 000000000182c38b/0xcbde9110e47c0dbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0dc6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725867.313260:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: 000000000182c38b/0xcbde9110e47c0dbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0dc6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725867.313309:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f1b8f810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935024128:0@lo:501: 00000100:00100000:2.0:1788725867.313337:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725867.313453:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000004ae3878e going to sleep for 11 seconds 00000100:00100000:3.0:1788725867.319322:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935024128 00000100:00100000:3.0:1788725867.319342:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935024128 00000100:00100000:3.0:1788725867.319452:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788725867.319463:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bfd1d20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+6:5814:x1875614935024128:12345-0@lo:501: 00000100:00100000:3.0:1788725867.319800:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bfd1d20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+6:5814:x1875614935024128:12345-0@lo:501: Request processed in 339us (6462us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788725867.319809:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788725867.319910:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f1b8f810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935024128:0@lo:501: 10000000:01000000:2.0:1788725867.319953:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788725867.319982:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: 000000000182c38b/0xcbde9110e47c0dbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0dc6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725867.319993:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: 000000000182c38b/0xcbde9110e47c0dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0dc6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725867.320002:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91a120292000 10000000:01000000:2.0:1788725867.320007:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788725867.320011:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91a120292000 10000000:01000000:2.0:1788725867.320013:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788725867.320016:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91a120292000 from 1 10000000:01000000:2.0:1788725867.320019:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788725867.320055:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: 0000000096fe72bd/0xcbde9110e47c0dcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725867.320063:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: 0000000096fe72bd/0xcbde9110e47c0dcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725867.320083:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: 0000000096fe72bd/0xcbde9110e47c0dcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725867.320115:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f1b8f810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935024256:0@lo:101: 00000100:00100000:2.0:1788725867.320154:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725867.331937:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000004ae3878e going to sleep for 11 seconds 00000100:00100000:0.0:1788725867.333188:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935024256 00000100:00100000:0.0:1788725867.333203:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935024256 00000100:00100000:0.0:1788725867.333279:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788725867.333291:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002df58443 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+6:5814:x1875614935024256:12345-0@lo:101: 00010000:00010000:0.0:1788725867.333310:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725867.333333:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000acd64375/0xcbde9110e47c0dd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0dcd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725867.333366:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000acd64375/0xcbde9110e47c0dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0dcd expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725867.333377:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000acd64375/0xcbde9110e47c0dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0dcd expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725867.333388:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000acd64375, rc 0) 00000100:00100000:0.0:1788725867.333474:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002df58443 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+7:5814:x1875614935024256:12345-0@lo:101: Request processed in 185us (13320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725867.333482:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788725867.333652:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f1b8f810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935024256:0@lo:101: 00010000:00010000:2.0:1788725867.333674:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: 0000000096fe72bd/0xcbde9110e47c0dcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0dd4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725867.333684:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: 0000000096fe72bd/0xcbde9110e47c0dcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0dd4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725867.333704:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788725867.333731:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: 0000000096fe72bd/0xcbde9110e47c0dcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0dd4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725867.333739:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: 0000000096fe72bd/0xcbde9110e47c0dcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0dd4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725867.333746:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788725867.333750:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788725867.333755:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91a120292000 10000000:01000000:2.0:1788725867.333758:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788725867.333761:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788725867.333764:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788725867.333790:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: 00000000d6cf7b91/0xcbde9110e47c0ddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725867.333797:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: 00000000d6cf7b91/0xcbde9110e47c0ddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725867.333815:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: 00000000d6cf7b91/0xcbde9110e47c0ddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725867.333834:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f1b8f810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935024384:0@lo:101: 00000100:00100000:2.0:1788725867.333873:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725867.333908:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000004ae3878e going to sleep for 11 seconds 00000100:00100000:0.0:1788725867.334035:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935024384 00000100:00100000:0.0:1788725867.334041:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935024384 00000100:00100000:0.0:1788725867.334062:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788725867.334067:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff5b7015 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+7:5814:x1875614935024384:12345-0@lo:101: 00010000:00010000:0.0:1788725867.334088:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725867.334097:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000321331d3/0xcbde9110e47c0de2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0ddb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725867.334111:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000321331d3/0xcbde9110e47c0de2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0ddb expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725867.334119:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000321331d3/0xcbde9110e47c0de2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0ddb expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725867.334126:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000321331d3, rc 0) 00000100:00100000:0.0:1788725867.334162:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff5b7015 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+8:5814:x1875614935024384:12345-0@lo:101: Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725867.334168:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788725867.334307:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f1b8f810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935024384:0@lo:101: 00010000:00010000:2.0:1788725867.334318:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: 00000000d6cf7b91/0xcbde9110e47c0ddb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0de2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725867.334327:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: 00000000d6cf7b91/0xcbde9110e47c0ddb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0de2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725867.334374:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f1b8f810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935024512:0@lo:501: 00000100:00100000:2.0:1788725867.334398:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725867.334423:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000004ae3878e going to sleep for 11 seconds 00000100:00100000:0.0:1788725867.336213:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935024512 00000100:00100000:0.0:1788725867.336266:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935024512 00000100:00100000:0.0:1788725867.336323:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788725867.336333:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1b481b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+8:5814:x1875614935024512:12345-0@lo:501: 00000100:00100000:0.0:1788725867.336655:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1b481b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+9:5814:x1875614935024512:12345-0@lo:501: Request processed in 323us (2256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725867.336665:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788725867.336891:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f1b8f810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935024512:0@lo:501: 00000100:00100000:2.0:1788725867.336940:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f1b8f810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935024640:0@lo:503: 00000100:00100000:2.0:1788725867.336987:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725867.337024:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000004ae3878e going to sleep for 11 seconds 00000100:00100000:0.0:1788725867.339802:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935024640 00000100:00100000:0.0:1788725867.339821:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935024640 00000100:00100000:0.0:1788725867.339885:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788725867.339895:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2027065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+9:5814:x1875614935024640:12345-0@lo:503: 00000100:00100000:0.0:1788725867.340431:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2027065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+9:5814:x1875614935024640:12345-0@lo:503: Request processed in 537us (3442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725867.340442:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788725867.340572:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f1b8f810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935024640:0@lo:503: 00000100:00100000:3.0:1788725867.341196:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d6ceafc pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5858:1875614935024768:0@lo:502: 00000100:00100000:3.0:1788725867.341273:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725867.341348:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ca43bfd going to sleep for 11 seconds 00000100:00100000:0.0:1788725867.341402:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935024768 00000100:00100000:0.0:1788725867.341409:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935024768 00000100:00100000:0.0:1788725867.341445:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788725867.341453:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc9f7f27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+9:5858:x1875614935024768:12345-0@lo:502: 00000100:00100000:0.0:1788725867.341644:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc9f7f27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+9:5858:x1875614935024768:12345-0@lo:502: Request processed in 192us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725867.341652:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788725867.344906:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d6ceafc pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5858:1875614935024768:0@lo:502: 00000020:01000000:2.0:1788725867.344960:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788725867.344974:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725867.344977:0:5858:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788725867.344993:0:5858:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788725867.344997:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788725867.345014:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003288a777) 00000020:00000080:2.0:1788725867.345036:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788725867.345042:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788725867.345209:0:5858:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788725867.345480:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbde9110e47c0df0 00000020:00000080:2.0:1788725867.345813:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788725867.345819:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788725867.345824:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725867.345826:0:5858:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788725867.345828:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788725867.345832:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725867.345833:0:5858:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788725867.345837:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788725867.345845:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000062695b0) 00000020:00000080:2.0:1788725867.345856:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788725867.345860:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788725867.345862:0:5858:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788725867.345864:0:5858:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788725867.345870:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788725867.345919:0:5858:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000189d8b26 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788725867.345942:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000002bb6f968) 00000020:00000080:2.0:1788725867.345951:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788725867.346011:0:5858:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788725867.346016:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbde9110e47c0e05 00000020:00000080:2.0:1788725867.346875:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788725867.346884:0:5858:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788725867.346890:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcbde9110e47c0e0c 00080000:01000000:2.0:1788725867.346897:0:5858:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788725867.346901:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbde9110e47c0e13 00080000:10000000:2.0:1788725867.347562:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788725867.348634:0:5858:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788725867.359009:0:5858:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788725867.511526:0:5858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788725867.511961:0:5858:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788725867.517856:0:5858:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788725867.518636:0:5858:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:2.0:1788725867.542053:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788725867.563726:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000018ce1b43) 00000020:00000080:2.0:1788725867.563748:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788725867.563828:0:5858:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788725867.563835:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbde9110e47c0e21 00000020:00000080:1.0:1788725867.564653:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788725867.568586:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788725867.640241:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788725867.695161:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788725867.747282:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788725867.805262:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788725867.875291:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788725867.947376:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcbde9110e47c0e28 00000020:00000080:1.0:1788725867.950392:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788725867.950408:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725867.950416:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725867.950419:0:5858:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788725867.950422:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788725867.950426:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725867.950428:0:5858:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788725867.950431:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788725867.950433:0:5858:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788725867.950436:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725867.950438:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725867.950439:0:5858:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788725867.950442:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788725867.950446:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725867.950447:0:5858:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788725867.950451:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788725867.950508:0:5858:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788725867.950582:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb83272d pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5858:1875614935024896:0@lo:502: 00000100:00100000:1.0:1788725867.950660:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725867.950717:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 000000003865ae75 going to sleep for 11 seconds 00000100:00100000:0.0:1788725867.950793:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935024896 00000100:00100000:0.0:1788725867.950802:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935024896 00000100:00100000:0.0:1788725867.950855:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788725867.950865:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028325c58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+9:5858:x1875614935024896:12345-0@lo:502: 00000100:00100000:0.0:1788725867.951348:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028325c58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+9:5858:x1875614935024896:12345-0@lo:502: Request processed in 484us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725867.951357:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788725867.951663:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb83272d pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5858:1875614935024896:0@lo:502: 00000020:01000000:1.0:1788725867.951692:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725867.951697:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725867.951699:0:5858:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788725867.951714:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788725867.951807:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788725867.951833:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788725867.951867:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: 00000000d6cf7b91/0xcbde9110e47c0ddb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0de2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725867.951879:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: 00000000d6cf7b91/0xcbde9110e47c0ddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0de2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725867.951887:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91a120292000 from 1 10000000:01000000:3.0:1788725867.951891:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788725867.951923:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: 0000000023d435e4/0xcbde9110e47c0e2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725867.951930:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: 0000000023d435e4/0xcbde9110e47c0e2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725867.951953:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: 0000000023d435e4/0xcbde9110e47c0e2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725867.951968:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acca6a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025024:0@lo:101: 00000100:00100000:3.0:1788725867.952007:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725867.952052:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099684c15 going to sleep for 11 seconds 00000100:00100000:1.0:1788725867.952842:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935025024 00000100:00100000:1.0:1788725867.952852:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935025024 00000100:00100000:1.0:1788725867.952891:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788725867.952899:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce21cf6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+9:5814:x1875614935025024:12345-0@lo:101: 00010000:00010000:1.0:1788725867.952914:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725867.952933:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000d4fec00/0xcbde9110e47c0e36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0e2f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725867.952972:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000d4fec00/0xcbde9110e47c0e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0e2f expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725867.952985:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000d4fec00/0xcbde9110e47c0e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0e2f expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725867.952995:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000d4fec00, rc 0) 00000100:00100000:1.0:1788725867.953040:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce21cf6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+10:5814:x1875614935025024:12345-0@lo:101: Request processed in 142us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725867.953047:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788725867.953242:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acca6a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025024:0@lo:101: 00010000:00010000:3.0:1788725867.953260:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: 0000000023d435e4/0xcbde9110e47c0e2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0e36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725867.953271:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: 0000000023d435e4/0xcbde9110e47c0e2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0e36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725867.954155:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acca6a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025152:0@lo:256: 00000100:00100000:3.0:1788725867.954247:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725867.954279:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099684c15 going to sleep for 11 seconds 00000100:00100000:0.0:1788725867.954309:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935025152 00000100:00100000:0.0:1788725867.954319:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935025152 00000100:00100000:0.0:1788725867.954369:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788725867.954378:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028c1b6aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+10:5814:x1875614935025152:12345-0@lo:256: 20000000:01000000:0.0:1788725867.954397:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788725867.954403:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788725867.954488:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028c1b6aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+10:5814:x1875614935025152:12345-0@lo:256: Request processed in 112us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725867.954509:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788725867.955739:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acca6a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025152:0@lo:256: 10000000:01000000:3.0:1788725867.956374:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788725867.956401:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: 0000000023d435e4/0xcbde9110e47c0e2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0e36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725867.956414:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: 0000000023d435e4/0xcbde9110e47c0e2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0e36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725867.956424:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a120292000 from 1 10000000:01000000:3.0:1788725867.956427:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788725867.956476:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: 000000009a9fa24b/0xcbde9110e47c0e3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725867.956484:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: 000000009a9fa24b/0xcbde9110e47c0e3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725867.956504:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: 000000009a9fa24b/0xcbde9110e47c0e3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725867.956523:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acca6a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025280:0@lo:101: 00000100:00100000:3.0:1788725867.956583:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725867.956626:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099684c15 going to sleep for 11 seconds 00000100:00100000:0.0:1788725867.956657:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935025280 00000100:00100000:0.0:1788725867.956665:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935025280 00000100:00100000:0.0:1788725867.956725:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788725867.956734:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003331b1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+10:5814:x1875614935025280:12345-0@lo:101: 00010000:00010000:0.0:1788725867.956748:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725867.956762:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000320fa8c6/0xcbde9110e47c0e44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0e3d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725867.956788:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000320fa8c6/0xcbde9110e47c0e44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0e3d expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725867.956799:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000320fa8c6/0xcbde9110e47c0e44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0e3d expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725867.956810:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000320fa8c6, rc 0) 00000100:00100000:0.0:1788725867.956858:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003331b1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:5814:x1875614935025280:12345-0@lo:101: Request processed in 125us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725867.956865:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788725867.957435:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acca6a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025280:0@lo:101: 00010000:00010000:3.0:1788725867.957452:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: 000000009a9fa24b/0xcbde9110e47c0e3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0e44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725867.957462:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: 000000009a9fa24b/0xcbde9110e47c0e3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0e44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725867.957528:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acca6a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025408:0@lo:501: 00000100:00100000:3.0:1788725867.957560:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725867.957583:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099684c15 going to sleep for 11 seconds 00000100:00100000:0.0:1788725867.957691:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935025408 00000100:00100000:0.0:1788725867.957697:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935025408 00000100:00100000:0.0:1788725867.957735:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788725867.957743:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cc42e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:5814:x1875614935025408:12345-0@lo:501: 00000100:00100000:0.0:1788725867.958973:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cc42e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:5814:x1875614935025408:12345-0@lo:501: Request processed in 1227us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725867.958986:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788725867.959612:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acca6a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025408:0@lo:501: 00000100:00100000:3.0:1788725867.959662:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acca6a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025536:0@lo:503: 00000100:00100000:3.0:1788725867.959712:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725867.959740:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099684c15 going to sleep for 11 seconds 00000100:00100000:1.0:1788725867.959870:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935025536 00000100:00100000:1.0:1788725867.959879:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935025536 00000100:00100000:1.0:1788725867.959919:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788725867.959934:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a39a90be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:5814:x1875614935025536:12345-0@lo:503: 00000040:00080000:1.0:1788725867.959977:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788725867.960031:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a39a90be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:5814:x1875614935025536:12345-0@lo:503: Request processed in 99us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725867.960039:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788725867.960898:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acca6a24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025536:0@lo:503: 00000040:00080000:0.0:1788725867.961863:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788725867.962145:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788725867.962167:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788725867.962199:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: 000000009a9fa24b/0xcbde9110e47c0e3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0e44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725867.962211:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: 000000009a9fa24b/0xcbde9110e47c0e3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0e44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725867.962280:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788725867.962283:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91a120292000 10000000:01000000:3.0:1788725867.962286:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91a120292000 10000000:01000000:3.0:1788725867.962290:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788725867.962296:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91a120292000 from 1 10000000:01000000:3.0:1788725867.962299:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788725867.962331:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: 00000000c92665e6/0xcbde9110e47c0e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725867.962339:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: 00000000c92665e6/0xcbde9110e47c0e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725867.962349:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: 00000000c92665e6/0xcbde9110e47c0e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725867.962367:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f0eceef pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025664:0@lo:101: 00000100:00100000:3.0:1788725867.962429:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725867.962467:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000139ff795 going to sleep for 11 seconds 00000100:00100000:1.0:1788725867.962552:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935025664 00000100:00100000:1.0:1788725867.962560:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935025664 00000100:00100000:1.0:1788725867.962607:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788725867.962616:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b9b8ece pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:5814:x1875614935025664:12345-0@lo:101: 00010000:00010000:1.0:1788725867.962629:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725867.962642:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000979ae525/0xcbde9110e47c0e52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0e4b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725867.962666:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000979ae525/0xcbde9110e47c0e52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0e4b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725867.962675:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000979ae525/0xcbde9110e47c0e52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0e4b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725867.962684:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000979ae525, rc 0) 00000100:00100000:1.0:1788725867.962724:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b9b8ece pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5814:x1875614935025664:12345-0@lo:101: Request processed in 109us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725867.962731:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788725867.962987:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f0eceef pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025664:0@lo:101: 00010000:00010000:3.0:1788725867.963000:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: 00000000c92665e6/0xcbde9110e47c0e4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0e52 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725867.963008:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: 00000000c92665e6/0xcbde9110e47c0e4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0e52 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725867.963075:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f0eceef pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025792:0@lo:501: 00000100:00100000:3.0:1788725867.963099:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725867.963156:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000139ff795 going to sleep for 11 seconds 00000100:00100000:1.0:1788725867.967788:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935025792 00000100:00100000:1.0:1788725867.967811:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935025792 00000100:00100000:1.0:1788725867.967877:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788725867.967887:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b72c8e94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5814:x1875614935025792:12345-0@lo:501: 00000100:00100000:1.0:1788725867.968255:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b72c8e94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5814:x1875614935025792:12345-0@lo:501: Request processed in 368us (5154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725867.968272:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788725867.968426:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f0eceef pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025792:0@lo:501: 00000100:00100000:3.0:1788725867.968482:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f0eceef pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025920:0@lo:503: 00000100:00100000:3.0:1788725867.968539:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725867.968580:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000139ff795 going to sleep for 11 seconds 00000100:00100000:1.0:1788725867.968629:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935025920 00000100:00100000:1.0:1788725867.968634:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935025920 00000100:00100000:1.0:1788725867.968704:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788725867.968711:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070389fc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5814:x1875614935025920:12345-0@lo:503: 00000100:00100000:1.0:1788725867.969047:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070389fc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5814:x1875614935025920:12345-0@lo:503: Request processed in 337us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725867.969055:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788725867.970936:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f0eceef pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935025920:0@lo:503: 00000100:00100000:1.0:1788725867.971959:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb83272d pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5863:1875614935026048:0@lo:502: 00000100:00100000:1.0:1788725867.972043:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725867.972088:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2789170 going to sleep for 11 seconds 00000100:00100000:0.0:1788725867.972158:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935026048 00000100:00100000:0.0:1788725867.972166:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935026048 00000100:00100000:0.0:1788725867.972237:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788725867.972245:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e38574dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5863:x1875614935026048:12345-0@lo:502: 00000100:00100000:0.0:1788725867.972504:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e38574dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5863:x1875614935026048:12345-0@lo:502: Request processed in 250us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725867.972513:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788725867.972627:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb83272d pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5863:1875614935026048:0@lo:502: 00000020:01000004:1.0:1788725867.972686:0:5863:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788725867.972708:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000004e443938) 00000020:00000080:1.0:1788725867.972726:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788725867.972792:0:5863:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000189d8b26 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788725867.972796:0:5863:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000189d8b26 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788725867.972798:0:5863:0:(obd_mount.c:721:lustre_put_lsi()) put 00000000189d8b26 4 00010000:00080000:1.0:1788725867.972823:0:5863:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000bb78499f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:1.0:1788725867.974772:0:5863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788725867.975159:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788725867.975197:0:5863:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788725867.975207:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcbde9110e47c0e60 00000100:00080000:1.0:1788725867.975350:0:5863:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788725867.975356:0:5863:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000bb78499f using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788725867.975409:0:5863:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000eb83272d x1875614935026176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788725867.975442:0:5863:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788725867.975544:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb83272d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875614935026176:0@lo:38: 00000100:00100000:2.0:1788725867.975622:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725867.981730:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935026176 00000100:00100000:1.0:1788725867.981749:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935026176 00000100:00100000:1.0:1788725867.981809:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788725867.981819:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b8f810 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875614935026176:12345-0@lo:38: 00000100:00100000:1.0:1788725867.981971:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b8f810 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875614935026176:12345-0@lo:38: Request processed in 152us (6349us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788725867.981979:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788725867.982024:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788725867.982034:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000bb78499f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788725867.982039:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788725867.982042:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb83272d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875614935026176:0@lo:38: 00000100:00100000:0.0:1788725867.987965:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ce0c7aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5863:1875614935026304:0@lo:502: 00000100:00100000:0.0:1788725867.988062:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725867.988109:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 00000000401fb4d8 going to sleep for 11 seconds 00000100:00100000:1.0:1788725867.993191:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935026304 00000100:00100000:1.0:1788725867.993209:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935026304 00000100:00100000:1.0:1788725867.993297:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788725867.993310:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005104f39b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5863:x1875614935026304:12345-0@lo:502: 00000100:00100000:1.0:1788725867.993664:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005104f39b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5863:x1875614935026304:12345-0@lo:502: Request processed in 356us (5603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725867.993674:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788725867.993754:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ce0c7aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5863:1875614935026304:0@lo:502: 00000040:00080000:1.0:1788725867.993795:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788725867.994198:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788725867.994247:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788725867.994269:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: 00000000c92665e6/0xcbde9110e47c0e4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0e52 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725867.994282:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: 00000000c92665e6/0xcbde9110e47c0e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0e52 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788725867.994323:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788725867.994326:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788725867.994327:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788725867.994328:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788725867.994329:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788725867.994330:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788725867.994332:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788725867.994333:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788725867.994334:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788725867.994335:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788725867.994336:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788725867.994337:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788725867.994340:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788725867.994343:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788725867.994349:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788725867.994351:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788725867.994352:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788725867.994353:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788725867.994355:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788725867.994355:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788725867.994357:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788725867.994358:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788725867.994359:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788725867.994360:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788725867.994361:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788725867.994385:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788725867.994401:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b9106b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935026432:0@lo:253: 00000100:00100000:0.0:1788725867.994453:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725867.994515:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d4b3db2 going to sleep for 11 seconds 00000100:00100000:3.0:1788725867.994526:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935026432 00000100:00100000:3.0:1788725867.994534:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935026432 00000100:00100000:3.0:1788725867.994629:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788725867.994640:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a2d122a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5814:x1875614935026432:12345-0@lo:253: 20000000:01000000:3.0:1788725867.994666:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788725867.994680:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788725868.018765:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788725868.018810:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788725868.022763:0:5850:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788725868.022775:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788725868.022801:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ea35bab7/0xcbde9110e47c0e67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725868.022823:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000d4fec00/0xcbde9110e47c0e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0e2f expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725868.022833:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ea35bab7/0xcbde9110e47c0e67 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725868.022880:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000d4fec00/0xcbde9110e47c0e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0e2f expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725868.022896:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000d4fec00/0xcbde9110e47c0e36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0e2f expref: 12 pid: 5827 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725868.022931:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000392ac010 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1875614935026560:0@lo:104: 00000100:00100000:2.0:1788725868.022997:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725868.023051:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set 00000000854a252f going to sleep for 11 seconds 00000100:00100000:1.0:1788725868.023107:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935026560 00000100:00100000:1.0:1788725868.023116:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935026560 00000100:00100000:1.0:1788725868.023171:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788725868.023181:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005631dc76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5850:x1875614935026560:12345-0@lo:104: 00010000:00010000:1.0:1788725868.023194:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: 0000000023d435e4/0xcbde9110e47c0e2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0e36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023273:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788725868.023279:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005631dc76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5850:x1875614935026560:12345-0@lo:104: Request processed in 100us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725868.023292:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788725868.023317:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788725868.023322:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: 0000000023d435e4/0xcbde9110e47c0e2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0e36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023330:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000023d435e4 already unused, calling callback (00000000bf48bcfe) 10000000:00010000:1.0:1788725868.023333:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: 0000000023d435e4/0xcbde9110e47c0e2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0e36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023341:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: 0000000023d435e4/0xcbde9110e47c0e2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0e36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788725868.023347:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: 0000000023d435e4/0xcbde9110e47c0e2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0e36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725868.023352:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788725868.023380:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: 0000000023d435e4/0xcbde9110e47c0e2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0e36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023387:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788725868.023402:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: 0000000023d435e4/0xcbde9110e47c0e2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0e36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023408:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: 0000000023d435e4/0xcbde9110e47c0e2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0e36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023425:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725868.023427:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725868.023428:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725868.023479:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098b4de01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935026688:0@lo:103: 00000100:00100000:1.0:1788725868.023526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725868.023563:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935026688 00000100:00100000:1.0:1788725868.023568:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935026688 00010000:00010000:1.0:1788725868.023583:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000d4fec00/0xcbde9110e47c0e36 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0e2f expref: 13 pid: 5827 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725868.023605:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788725868.023611:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000698b49fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:3305:x1875614935026688:12345-0@lo:103: 00010000:00010000:1.0:1788725868.023621:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725868.023627:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000d4fec00/0xcbde9110e47c0e36 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0e2f expref: 13 pid: 5827 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023637:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000d4fec00/0xcbde9110e47c0e36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0e2f expref: 13 pid: 5827 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023652:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ea35bab7/0xcbde9110e47c0e67 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023659:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea35bab7/0xcbde9110e47c0e67 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788725868.023672:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000897805s 00010000:00010000:1.0:1788725868.023675:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ea35bab7/0xcbde9110e47c0e67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023681:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ea35bab7/0xcbde9110e47c0e67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023687:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ea35bab7/0xcbde9110e47c0e67 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023705:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ea35bab7/0xcbde9110e47c0e67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023710:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ea35bab7 already unused, calling callback (000000004c776cbe) 00010000:00010000:1.0:1788725868.023714:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ea35bab7/0xcbde9110e47c0e67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023720:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ea35bab7/0xcbde9110e47c0e67 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023728:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ea35bab7/0xcbde9110e47c0e67 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725868.023739:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725868.023767:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000698b49fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:3305:x1875614935026688:12345-0@lo:103: Request processed in 157us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725868.023773:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788725868.023810:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098b4de01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935026688:0@lo:103: 00010000:00010000:2.0:1788725868.023967:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000d4fec00/0xcbde9110e47c0e36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0e2f expref: 12 pid: 5827 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725868.023978:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000392ac010 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1875614935026560:0@lo:104: 00010000:00010000:2.0:1788725868.023991:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ea35bab7/0xcbde9110e47c0e67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725868.023998:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ea35bab7/0xcbde9110e47c0e67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725868.024002:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ea35bab7/0xcbde9110e47c0e67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725868.024006:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ea35bab7/0xcbde9110e47c0e67 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725868.026121:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a2d122a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:5814:x1875614935026432:12345-0@lo:253: Request processed in 31477us (31661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725868.026136:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788725868.026389:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b9106b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5814:1875614935026432:0@lo:253: 10000000:01000000:0.0:1788725868.026406:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788725868.026410:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788725868.026411:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788725868.026413:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788725868.026414:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788725868.026415:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788725868.026416:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788725868.026417:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788725868.026419:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788725868.026420:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788725868.026421:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788725868.026423:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788725868.026424:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788725868.026438:0:5814:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788725868.031673:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788725868.032133:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788725868.032379:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788725868.032554:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788725868.034014:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788725868.034432:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788725868.035121:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788725868.035626:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788725868.035936:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788725868.036113:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788725868.036464:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788725868.036650:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788725868.072670:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788725868.101919:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788725868.102054:0:5868:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788725868.102058:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788725868.102157:0:5869:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788725868.105886:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788725868.106092:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788725868.106657:0:5814:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788725868.106667:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788725868.106992:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788725868.108176:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788725868.110930:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788725868.111001:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788725868.114583:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788725868.115280:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788725868.116974:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788725868.117129:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788725868.117306:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788725868.117457:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788725868.117619:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788725868.117758:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788725868.117910:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788725868.118049:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788725868.118199:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788725868.118398:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788725868.118557:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788725868.118690:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788725868.118848:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788725868.118995:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788725868.119149:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788725868.119325:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788725868.121124:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788725868.121292:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788725868.121425:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788725868.121574:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788725868.122053:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788725868.122194:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788725868.125079:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788725868.125280:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788725868.125448:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788725868.125603:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788725868.125817:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788725868.125967:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788725868.126101:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788725868.126266:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788725868.126421:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788725868.126571:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788725868.128364:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788725868.170771:0:5869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788725868.309465:0:5814:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788725868.309512:0:5814:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb86a81c4b988 00100000:10000000:2.0:1788725868.309521:0:5814:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788725868.314425:0:5814:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788725868.314447:0:5814:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788725868.314462:0:5814:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788725868.314481:0:5814:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788725868.413327:0:5869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788725868.413413:0:5869:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788725868.413419:0:5869:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788725868.565390:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725869.589434:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725870.613543:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725871.638459:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725872.673645:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788725873.369677:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788725873.369688:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788725873.369692:0:8:0:(import.c:65:import_set_state_nolock()) 00000000bb78499f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788725873.369707:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000bb78499f using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788725873.369734:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ca172cae x1875614935026944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788725873.369785:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca172cae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875614935026944:0@lo:38: 00000100:00100000:0.0:1788725873.369876:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725873.369956:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935026944 00000100:00100000:0.0:1788725873.369966:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935026944 00000100:00100000:0.0:1788725873.370007:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788725873.370016:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac3a6cf9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875614935026944:12345-0@lo:38: 00000100:00100000:3.0:1788725873.370022:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b9106b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935026816:0@lo:400: 00010000:00080000:0.0:1788725873.370047:0:5836:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:0.0:1788725873.370085:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcbde9110e47c0e6e 00000100:00100000:3.0:1788725873.370124:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:0.0:1788725873.370131:0:5836:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788725873.370329:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935026816 00000100:00080000:0.0:1788725873.370332:0:5836:0:(import.c:65:import_set_state_nolock()) 0000000005e50df2 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788725873.370335:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935026816 00000100:00100000:1.0:1788725873.370383:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788725873.370389:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac3a6cf9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875614935026944:12345-0@lo:38: Request processed in 372us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725873.370395:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092a4f18f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:3306:x1875614935026816:12345-0@lo:400: 00000100:00100000:0.0:1788725873.370414:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788725873.370458:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092a4f18f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:3306:x1875614935026816:12345-0@lo:400: Request processed in 67us (334us total) trans 0 rc 0/0 00010000:00080000:0.0:1788725873.370465:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ca172cae x1875614935026944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788725883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725873.370468:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788725873.370485:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788725873.370495:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788725873.370500:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788725873.370502:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000bb78499f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788725873.370509:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b9106b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935026816:0@lo:400: 00000100:00100000:0.0:1788725873.370518:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca172cae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875614935026944:0@lo:38: 00000001:02000400:0.0:1788725873.645093:0:6112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788725873.688686:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788725873.886533:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788725873.886541:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91a120292000 from 3 10000000:01000000:2.0:1788725873.886546:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788725873.886595:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: 000000006a8f7ad3/0xcbde9110e47c0e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725873.886608:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: 000000006a8f7ad3/0xcbde9110e47c0e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725873.886620:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: 000000006a8f7ad3/0xcbde9110e47c0e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725873.886642:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000392ac010 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935027072:0@lo:101: 00000100:00100000:2.0:1788725873.886710:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725873.886758:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000294ea27d going to sleep for 11 seconds 00000100:00100000:2.0:1788725873.886784:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935027072 00000100:00100000:2.0:1788725873.886791:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935027072 00000100:00100000:2.0:1788725873.886840:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788725873.886850:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c21ec3d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:5831:x1875614935027072:12345-0@lo:101: 00010000:00010000:2.0:1788725873.886864:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725873.886882:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004d78cf52/0xcbde9110e47c0e7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0e75 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725873.886908:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d78cf52/0xcbde9110e47c0e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0e75 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725873.886919:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004d78cf52/0xcbde9110e47c0e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0e75 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725873.886929:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004d78cf52, rc 0) 00000100:00100000:2.0:1788725873.886981:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c21ec3d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5831:x1875614935027072:12345-0@lo:101: Request processed in 132us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725873.886988:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788725873.887036:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000392ac010 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935027072:0@lo:101: 00010000:00010000:2.0:1788725873.887051:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: 000000006a8f7ad3/0xcbde9110e47c0e75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0e7c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725873.887059:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: 000000006a8f7ad3/0xcbde9110e47c0e75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0e7c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725873.887101:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000392ac010 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935027200:0@lo:256: 00000100:00100000:2.0:1788725873.887129:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725873.887143:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000294ea27d going to sleep for 11 seconds 00000100:00100000:2.0:1788725873.887156:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935027200 00000100:00100000:2.0:1788725873.887159:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935027200 00000100:00100000:2.0:1788725873.887180:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788725873.887186:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001105748 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5831:x1875614935027200:12345-0@lo:256: 20000000:01000000:2.0:1788725873.887199:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788725873.887241:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788725873.887250:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788725873.887320:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001105748 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5831:x1875614935027200:12345-0@lo:256: Request processed in 134us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725873.887327:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788725873.887363:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000392ac010 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935027200:0@lo:256: 10000000:01000000:2.0:1788725873.887415:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788725873.887421:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: 000000006a8f7ad3/0xcbde9110e47c0e75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0e7c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725873.887429:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: 000000006a8f7ad3/0xcbde9110e47c0e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0e7c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725874.709447:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725875.747505:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725876.757495:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725877.781599:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725878.485801:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e9f7e07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935027456:0@lo:400: 00000100:00100000:2.0:1788725878.485891:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725878.485980:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935027456 00000100:00100000:2.0:1788725878.485989:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935027456 00000100:00100000:2.0:1788725878.486035:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788725878.486044:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec11065b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935027456:12345-0@lo:400: 00000100:00100000:2.0:1788725878.486114:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec11065b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935027456:12345-0@lo:400: Request processed in 72us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725878.486122:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788725878.486164:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000e9f7e07 x1875614935027456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725878.486177:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e9f7e07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935027456:0@lo:400: 00000100:00100000:1.0:1788725878.486347:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725878.486360:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000392ac010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935027328:0@lo:400: 00000100:00100000:1.0:1788725878.486400:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725878.487662:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935027328 00000100:00100000:2.0:1788725878.487675:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935027328 00000100:00100000:2.0:1788725878.487721:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788725878.487729:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006820fff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:3306:x1875614935027328:12345-0@lo:400: 00000100:00100000:2.0:1788725878.487806:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006820fff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:3306:x1875614935027328:12345-0@lo:400: Request processed in 78us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725878.487813:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788725878.487921:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000392ac010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935027328:0@lo:400: 00010000:00010000:2.0:1788725878.805426:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788725879.303705:0:6313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffecfd0130 20000000:00000080:1.0:1788725879.303731:0:6313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91a1089f5000 uarg=0000000000000000 20000000:01000000:1.0:1788725879.303768:0:6313:0:(mgs_llog.c:6195:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788725879.303777:0:6313:0:(mgs_llog.c:4650:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788725879.303783:0:6313:0:(mgs_llog.c:1382:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788725879.304751:0:6313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788725879.304767:0:6313:0:(mgs_llog.c:4123:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788725879.314363:0:6313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788725879.314874:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788725879.314938:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788725879.314980:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788725879.314993:0:6313:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788725879.315009:0:6313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e6138ba1/0xcbde9110e47c0e83 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725879.315023:0:6313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000320fa8c6/0xcbde9110e47c0e44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0e3d expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725879.315028:0:6313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e6138ba1/0xcbde9110e47c0e83 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725879.315070:0:6313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000320fa8c6/0xcbde9110e47c0e44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0e3d expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725879.315080:0:6313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000320fa8c6/0xcbde9110e47c0e44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0e3d expref: 11 pid: 5829 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725879.315090:0:6313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca172cae pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6313:1875614935027584:0@lo:104: 00000100:00100000:0.0:1788725879.315143:0:6313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725879.315238:0:6313:0:(client.c:2715:ptlrpc_set_wait()) set 00000000471aa9ea going to sleep for 11 seconds 00000100:00100000:3.0:1788725879.322829:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935027584 00000100:00100000:3.0:1788725879.322846:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935027584 00000100:00100000:3.0:1788725879.322929:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788725879.322939:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007dc072d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:6313:x1875614935027584:12345-0@lo:104: 00010000:00010000:3.0:1788725879.322958:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: 000000009a9fa24b/0xcbde9110e47c0e3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0e44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725879.323067:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788725879.323073:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007dc072d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:6313:x1875614935027584:12345-0@lo:104: Request processed in 136us (7930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725879.323080:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788725879.323430:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788725879.323436:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: 000000009a9fa24b/0xcbde9110e47c0e3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0e44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323445:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009a9fa24b already unused, calling callback (00000000bf48bcfe) 10000000:00010000:1.0:1788725879.323448:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: 000000009a9fa24b/0xcbde9110e47c0e3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0e44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323455:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: 000000009a9fa24b/0xcbde9110e47c0e3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0e44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788725879.323472:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: 000000009a9fa24b/0xcbde9110e47c0e3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0e44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725879.323478:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788725879.323531:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: 000000009a9fa24b/0xcbde9110e47c0e3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0e44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323538:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788725879.323556:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: 000000009a9fa24b/0xcbde9110e47c0e3d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0e44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323572:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: 000000009a9fa24b/0xcbde9110e47c0e3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0e44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323586:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725879.323587:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725879.323589:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725879.323643:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098b4de01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935027712:0@lo:103: 00000100:00100000:1.0:1788725879.323687:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725879.323740:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935027712 00000100:00100000:1.0:1788725879.323744:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935027712 00010000:00010000:1.0:1788725879.323764:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000320fa8c6/0xcbde9110e47c0e44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0e3d expref: 12 pid: 5829 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725879.323787:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788725879.323793:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a559eaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:3305:x1875614935027712:12345-0@lo:103: 00010000:00010000:1.0:1788725879.323804:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725879.323808:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000320fa8c6/0xcbde9110e47c0e44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0e3d expref: 12 pid: 5829 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323826:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000320fa8c6/0xcbde9110e47c0e44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0e3d expref: 12 pid: 5829 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323842:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e6138ba1/0xcbde9110e47c0e83 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323849:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6138ba1/0xcbde9110e47c0e83 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323864:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e6138ba1/0xcbde9110e47c0e83 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323870:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e6138ba1/0xcbde9110e47c0e83 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323875:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e6138ba1/0xcbde9110e47c0e83 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323880:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e6138ba1/0xcbde9110e47c0e83 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323885:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e6138ba1 already unused, calling callback (000000004c776cbe) 00010000:00010000:1.0:1788725879.323887:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e6138ba1/0xcbde9110e47c0e83 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323894:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e6138ba1/0xcbde9110e47c0e83 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323901:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e6138ba1/0xcbde9110e47c0e83 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725879.323920:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725879.323951:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a559eaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:3305:x1875614935027712:12345-0@lo:103: Request processed in 158us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725879.323957:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788725879.323999:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098b4de01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935027712:0@lo:103: 00010000:00010000:0.0:1788725879.325005:0:6313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000320fa8c6/0xcbde9110e47c0e44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0e3d expref: 11 pid: 5829 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725879.325021:0:6313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca172cae pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6313:1875614935027584:0@lo:104: 00010000:00010000:0.0:1788725879.325038:0:6313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e6138ba1/0xcbde9110e47c0e83 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725879.325056:0:6313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e6138ba1/0xcbde9110e47c0e83 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725879.325062:0:6313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e6138ba1/0xcbde9110e47c0e83 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725879.325067:0:6313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e6138ba1/0xcbde9110e47c0e83 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725879.829962:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788725880.602649:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788725880.602657:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a120292000 from 1 10000000:01000000:3.0:1788725880.602663:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788725880.602712:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: 00000000c55ee2ec/0xcbde9110e47c0e8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725880.602725:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: 00000000c55ee2ec/0xcbde9110e47c0e8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725880.602734:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: 00000000c55ee2ec/0xcbde9110e47c0e8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725880.602772:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000454912d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935027840:0@lo:101: 00000100:00100000:3.0:1788725880.602844:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725880.602909:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000003266f6f9 going to sleep for 11 seconds 00000100:00100000:0.0:1788725880.602976:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935027840 00000100:00100000:0.0:1788725880.602985:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935027840 00000100:00100000:0.0:1788725880.603040:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788725880.603049:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002beccdd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:5831:x1875614935027840:12345-0@lo:101: 00010000:00010000:0.0:1788725880.603070:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725880.603083:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000320fa8c6/0xcbde9110e47c0e91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0e8a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725880.603102:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000320fa8c6/0xcbde9110e47c0e91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0e8a expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725880.603112:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000320fa8c6/0xcbde9110e47c0e91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0e8a expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725880.603121:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000320fa8c6, rc 0) 00000100:00100000:0.0:1788725880.603162:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002beccdd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5831:x1875614935027840:12345-0@lo:101: Request processed in 115us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725880.603169:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788725880.606617:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000454912d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935027840:0@lo:101: 00010000:00010000:3.0:1788725880.606649:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: 00000000c55ee2ec/0xcbde9110e47c0e8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0e91 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725880.606663:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: 00000000c55ee2ec/0xcbde9110e47c0e8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0e91 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725880.606743:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000454912d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935027968:0@lo:501: 00000100:00100000:3.0:1788725880.606814:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725880.606867:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000003266f6f9 going to sleep for 11 seconds 00000100:00100000:1.0:1788725880.606920:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935027968 00000100:00100000:1.0:1788725880.606927:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935027968 00000100:00100000:1.0:1788725880.606980:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788725880.606989:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ac3771b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5831:x1875614935027968:12345-0@lo:501: 00000100:00100000:1.0:1788725880.607268:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ac3771b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5831:x1875614935027968:12345-0@lo:501: Request processed in 281us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725880.607276:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788725880.609267:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000454912d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935027968:0@lo:501: 00000100:00100000:3.0:1788725880.609365:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000454912d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935028096:0@lo:503: 00000100:00100000:3.0:1788725880.609444:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725880.609495:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000003266f6f9 going to sleep for 11 seconds 00000100:00100000:3.0:1788725880.609521:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935028096 00000100:00100000:3.0:1788725880.609527:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935028096 00000100:00100000:3.0:1788725880.609585:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788725880.609594:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b58c00de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5831:x1875614935028096:12345-0@lo:503: 00000100:00100000:3.0:1788725880.609759:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b58c00de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5831:x1875614935028096:12345-0@lo:503: Request processed in 165us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725880.609767:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788725880.609816:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000454912d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935028096:0@lo:503: 00000100:00100000:3.0:1788725880.625979:0:6357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000454912d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6357:1875614935028224:0@lo:502: 00000100:00100000:3.0:1788725880.626070:0:6357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725880.626130:0:6357:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f053457 going to sleep for 11 seconds 00000100:00100000:2.0:1788725880.626457:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935028224 00000100:00100000:2.0:1788725880.626465:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935028224 00000100:00100000:2.0:1788725880.626585:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788725880.626593:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007376c0d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:6357:x1875614935028224:12345-0@lo:502: 00000100:00100000:2.0:1788725880.626790:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007376c0d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:6357:x1875614935028224:12345-0@lo:502: Request processed in 197us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725880.626798:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788725880.626878:0:6357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000454912d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6357:1875614935028224:0@lo:502: 00000020:01000000:1.0:1788725880.626909:0:6357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788725880.626922:0:6357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725880.626925:0:6357:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788725880.626936:0:6357:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a120292000 00000020:00000080:1.0:1788725880.626940:0:6357:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788725880.626985:0:6357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6357:1875614935028352:0@lo:502: 00000100:00100000:1.0:1788725880.627027:0:6357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725880.627077:0:6357:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a102aa1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788725880.627181:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935028352 00000100:00100000:3.0:1788725880.627186:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935028352 00000100:00100000:3.0:1788725880.627245:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788725880.627253:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:6357:x1875614935028352:12345-0@lo:502: 00000100:00100000:3.0:1788725880.627371:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:6357:x1875614935028352:12345-0@lo:502: Request processed in 118us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725880.627378:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788725880.627567:0:6357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6357:1875614935028352:0@lo:502: 00000020:01000000:1.0:1788725880.627589:0:6357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725880.627593:0:6357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725880.627595:0:6357:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788725880.627599:0:6357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788725880.627750:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788725880.627768:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788725880.627778:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71c00/0xcbde9110e47c0e8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0e91 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725880.627789:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10db71c00/0xcbde9110e47c0e8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0e91 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725880.863794:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725881.881367:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725882.901620:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725883.615836:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935028608:0@lo:400: 00000100:00100000:0.0:1788725883.615944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725883.616010:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725883.616017:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935028480:0@lo:400: 00000100:00100000:0.0:1788725883.616047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725883.616091:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935028480 00000100:00100000:0.0:1788725883.616099:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935028480 00000100:00100000:0.0:1788725883.616151:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788725883.616161:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:3307:x1875614935028480:12345-0@lo:400: 00000100:00100000:0.0:1788725883.616255:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:3307:x1875614935028480:12345-0@lo:400: Request processed in 95us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725883.616263:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788725883.616316:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935028480:0@lo:400: 00000100:00100000:3.0:1788725883.616566:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935028608 00000100:00100000:3.0:1788725883.616571:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935028608 00000100:00100000:3.0:1788725883.616610:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788725883.616618:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935028608:12345-0@lo:400: 00000100:00100000:3.0:1788725883.616677:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935028608:12345-0@lo:400: Request processed in 61us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725883.616684:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788725883.616791:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a1111da680 x1875614935028608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725883.616803:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935028608:0@lo:400: 00010000:00010000:3.0:1788725883.925350:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725884.951284:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725885.974484:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788725886.510082:0:6678:0:(obd_mount.c:934:lmd_print()) mount data: 00000020:01000004:2.0:1788725886.510086:0:6678:0:(obd_mount.c:937:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788725886.510297:0:6678:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91a10338f800 00000020:01000004:2.0:1788725886.510313:0:6678:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788725886.510323:0:6678:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788725886.510336:0:6678:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91a13b263370) 00000020:00000080:2.0:1788725886.510350:0:6678:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788725886.523881:0:6678:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788725886.524141:0:6678:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788725886.548073:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788725886.570277:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788725886.570342:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788725886.570710:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788725886.570757:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788725886.571810:0:6678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788725886.571822:0:6678:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788725886.571833:0:6678:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcbde9110e47c0e9f 00000020:01000004:2.0:1788725886.571841:0:6678:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788725886.571867:0:6678:0:(obd_mount.c:414:lustre_start_mgc()) MGC192.168.201.142@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788725886.571871:0:6678:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788725886.571877:0:6678:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788725886.571881:0:6678:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788725886.571894:0:6678:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91a13b264d28) 00000020:00000080:2.0:1788725886.571906:0:6678:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788725886.573760:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788725886.573947:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788725886.573954:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788725886.580294:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788725886.580310:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788725886.584341:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788725886.584354:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788725886.586098:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788725886.586766:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788725886.586773:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788725886.591914:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788725886.591929:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788725886.636085:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788725886.636869:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788725886.636878:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788725886.639726:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788725886.639755:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788725886.640968:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788725886.640979:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788725886.645532:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788725886.645888:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788725886.645895:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788725886.646870:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788725886.646888:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788725886.703511:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788725886.704012:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788725886.704020:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788725886.706904:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788725886.706920:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788725886.707890:0:6678:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788725886.707916:0:6678:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788725886.707922:0:6678:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788725886.754055:0:6678:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788725886.754105:0:6678:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.142@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788725886.754109:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788725886.754111:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788725886.754112:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788725886.754113:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788725886.754119:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788725886.754120:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788725886.754121:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788725886.754123:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788725886.754124:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788725886.754126:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788725886.754127:0:6678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788725886.754131:0:6678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788725886.754133:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788725886.754135:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788725886.754136:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788725886.754136:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788725886.754137:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788725886.754138:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788725886.754139:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788725886.754140:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788725886.754141:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788725886.754142:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788725886.754143:0:6678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788725886.754172:0:6678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788725886.754202:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935028736:0@lo:253: 00000100:00100000:2.0:1788725886.754357:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725886.754639:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935028736 00000100:00100000:3.0:1788725886.754648:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935028736 00000100:00100000:3.0:1788725886.754692:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788725886.754702:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:6678:x1875614935028736:12345-0@lo:253: 20000000:01000000:3.0:1788725886.754741:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788725886.754746:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788725886.754751:0:5829:0:(mgs_llog.c:872:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788725886.754754:0:5829:0:(mgs_llog.c:3865:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788725886.756065:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788725886.756350:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788725886.756364:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788725886.756416:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788725886.756424:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788725886.756473:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788725886.756527:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000100:00100000:2.0:1788725886.757033:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a11163bcc0 going to sleep for 11 seconds 00000040:00080000:3.0:1788725886.758022:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788725886.758045:0:5829:0:(mgs_llog.c:3818:mgs_write_log_osc_to_lov()) add nid 192.168.201.142@tcp 20000000:01000000:3.0:1788725886.758047:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf005 192.168.201.142@tcp (null) (null) (null) 00000040:00080000:3.0:1788725886.758083:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788725886.758091:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788725886.758140:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788725886.758157:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.142@tcp (null) (null) 00000040:00080000:3.0:1788725886.758252:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788725886.758263:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788725886.758299:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788725886.758356:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788725886.761892:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788725886.761922:0:5829:0:(mgs_llog.c:3818:mgs_write_log_osc_to_lov()) add nid 192.168.201.142@tcp 20000000:01000000:3.0:1788725886.761925:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf005 192.168.201.142@tcp (null) (null) (null) 00000040:00080000:3.0:1788725886.761972:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788725886.761980:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788725886.762012:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788725886.762021:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.142@tcp (null) (null) 00000040:00080000:3.0:1788725886.762064:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788725886.762074:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788725886.762107:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788725886.762142:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788725886.762158:0:5829:0:(mgs_llog.c:5255:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788725886.762161:0:5829:0:(mgs_llog.c:4751:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788725886.762165:0:5829:0:(mgs_llog.c:4184:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788725886.762187:0:5829:0:(mgs_llog.c:153:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788725886.762190:0:5829:0:(mgs_llog.c:153:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788725886.762411:0:5829:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788725886.762414:0:5829:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788725886.763505:0:6693:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788725886.763568:0:6693:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788725886.763986:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788725886.764974:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788725886.765019:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788725886.765101:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788725886.765115:0:5829:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788725886.765118:0:5829:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788725886.767458:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788725886.767965:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788725886.768007:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788725886.768076:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1788725886.768089:0:5829:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788725886.768091:0:5829:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788725886.770061:0:6695:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788725886.770139:0:6695:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788725886.770203:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788725886.772019:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788725886.772071:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788725886.772107:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788725886.772125:0:5829:0:(mgs_llog.c:5255:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788725886.772128:0:5829:0:(mgs_llog.c:4751:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788725886.772139:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788725886.772160:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725886.772192:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a100030e00/0xcbde9110e47c0dc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0dbf expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725886.772199:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0de2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0ddb expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725886.772206:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10149a200/0xcbde9110e47c0e52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0e4b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725886.772212:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725886.772380:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10149a200/0xcbde9110e47c0e52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0e4b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725886.772522:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a10149a200/0xcbde9110e47c0e52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0e4b expref: 12 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725886.772539:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935028864:0@lo:104: 00000100:00100000:1.0:1788725886.772721:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788725886.772903:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0de2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0ddb expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725886.772913:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0de2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0ddb expref: 12 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725886.772923:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139864380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935028992:0@lo:104: 00000100:00100000:1.0:1788725886.772947:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788725886.773095:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a100030e00/0xcbde9110e47c0dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0dbf expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725886.773103:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a100030e00/0xcbde9110e47c0dc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0dbf expref: 12 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725886.773110:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935029120:0@lo:104: 00000100:00100000:1.0:1788725886.773151:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725886.773232:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935028864 00000100:00100000:2.0:1788725886.773242:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935028864 00000100:00100000:2.0:1788725886.773282:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935028992 00000100:00100000:2.0:1788725886.773285:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935028992 00000100:00100000:2.0:1788725886.773297:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788725886.773305:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139866680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+4:5829:x1875614935028864:12345-0@lo:104: 00010000:00010000:2.0:1788725886.773317:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10db70000/0xcbde9110e47c0e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0e52 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725886.773395:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788725886.773402:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139866680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+4:5829:x1875614935028864:12345-0@lo:104: Request processed in 97us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725886.773408:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788725886.773424:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788725886.773430:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139867480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5829:x1875614935028992:12345-0@lo:104: 00010000:00010000:0.0:1788725886.773583:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788725886.773590:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10db70000/0xcbde9110e47c0e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0e52 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.773618:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10db70000 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788725886.773622:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10db70000/0xcbde9110e47c0e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0e52 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.773630:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10db70000/0xcbde9110e47c0e4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0e52 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725886.773637:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10db70000/0xcbde9110e47c0e4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0e52 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725886.773642:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788725886.773674:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10db70000/0xcbde9110e47c0e4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0e52 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.773681:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725886.773702:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10db70000/0xcbde9110e47c0e4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0e52 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.773709:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10db70000/0xcbde9110e47c0e4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0e52 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.773725:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725886.773727:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725886.773729:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788725886.773739:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788725886.773742:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91a120292000 from 21 10000000:01000000:0.0:1788725886.773746:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788725886.773763:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.773782:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.773801:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725886.773815:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935029376:0@lo:101: 00000100:00100000:0.0:1788725886.773847:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725886.773871:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a103c4acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725886.773887:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935029376 00000100:00100000:0.0:1788725886.773891:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935029376 00000100:00100000:0.0:1788725886.773916:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788725886.773923:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:5831:x1875614935029376:12345-0@lo:101: 00010000:00010000:0.0:1788725886.773934:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725886.773946:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0ebb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0eb4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.773963:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.773971:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0ebb lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0eb4 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.773984:0:5828:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.773995:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0ebb lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0eb4 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.774014:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100031c00, rc 0) 00000100:00100000:0.0:1788725886.774046:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:5831:x1875614935029376:12345-0@lo:101: Request processed in 123us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725886.774052:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788725886.774097:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935029376:0@lo:101: 00010000:00010000:0.0:1788725886.774109:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.774117:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725886.774316:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0ddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0de2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725886.774353:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788725886.774358:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139867480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5829:x1875614935028992:12345-0@lo:104: Request processed in 929us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725886.774365:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788725886.774415:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935029248:0@lo:103: 00000100:00100000:2.0:1788725886.774516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788725886.774638:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788725886.774644:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0ddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0de2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.774651:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725600 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788725886.774655:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0ddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0de2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.774662:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0de2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725886.774669:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0de2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725886.774675:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788725886.774692:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0ddb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0de2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.774704:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725886.774728:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0ddb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0de2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.774734:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0ddb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0de2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.774745:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725886.774747:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725886.774749:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725886.774756:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725886.774765:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935029504:0@lo:103: 00000100:00100000:0.0:1788725886.774921:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725886.775121:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935029248 00000100:00100000:1.0:1788725886.775126:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935029248 00010000:00010000:1.0:1788725886.775149:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10149a200/0xcbde9110e47c0e52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0e4b expref: 14 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725886.775193:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935029504 00000100:00100000:1.0:1788725886.775197:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935029504 00010000:00010000:1.0:1788725886.775210:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0de2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0ddb expref: 15 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725886.775244:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788725886.775251:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:3304:x1875614935029248:12345-0@lo:103: 00010000:00010000:1.0:1788725886.775260:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725886.775266:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10149a200/0xcbde9110e47c0e52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0e4b expref: 15 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725886.775276:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10149a200/0xcbde9110e47c0e52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0e4b expref: 15 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725886.775294:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725886.775325:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:3304:x1875614935029248:12345-0@lo:103: Request processed in 75us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725886.775331:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788725886.775343:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788725886.775348:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:3304:x1875614935029504:12345-0@lo:103: 00010000:00010000:1.0:1788725886.775355:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725886.775359:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0de2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0ddb expref: 14 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725886.775368:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0de2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0ddb expref: 14 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725886.775376:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725886.775423:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:3304:x1875614935029504:12345-0@lo:103: Request processed in 74us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725886.775430:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788725886.775534:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935029120 00000100:00100000:2.0:1788725886.775538:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935029120 00000100:00100000:2.0:1788725886.775560:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788725886.775566:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139867800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5829:x1875614935029120:12345-0@lo:104: 00010000:00010000:2.0:1788725886.775575:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10e725c00/0xcbde9110e47c0dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0dc6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725886.775620:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788725886.775626:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139867800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5829:x1875614935029120:12345-0@lo:104: Request processed in 60us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725886.775631:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788725886.775711:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788725886.775717:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e725c00/0xcbde9110e47c0dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0dc6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.775724:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725c00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788725886.775727:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725c00/0xcbde9110e47c0dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0dc6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.775735:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e725c00/0xcbde9110e47c0dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0dc6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725886.775741:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725c00/0xcbde9110e47c0dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0dc6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725886.775746:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788725886.775763:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e725c00/0xcbde9110e47c0dbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0dc6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.775774:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725886.775803:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e725c00/0xcbde9110e47c0dbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0dc6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.775810:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e725c00/0xcbde9110e47c0dbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0dc6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.775822:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725886.775824:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725886.775825:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725886.775832:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725886.775844:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935029632:0@lo:103: 00000100:00100000:0.0:1788725886.775873:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725886.775907:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935029632 00000100:00100000:0.0:1788725886.775911:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935029632 00010000:00010000:0.0:1788725886.775925:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a100030e00/0xcbde9110e47c0dc6 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0dbf expref: 15 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725886.775939:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788725886.775946:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:3307:x1875614935029632:12345-0@lo:103: 00010000:00010000:0.0:1788725886.775953:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725886.775957:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a100030e00/0xcbde9110e47c0dc6 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0dbf expref: 15 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.775966:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a100030e00/0xcbde9110e47c0dc6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0dbf expref: 15 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.775979:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.775998:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.776012:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.776019:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.776026:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.776033:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.776038:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149b200 already unused, calling callback (ffffffffc142a230) 00010000:00010000:0.0:1788725886.776042:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.776049:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.776057:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0ebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xcbde9110e47c0eb4 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.776064:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0ebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xcbde9110e47c0eb4 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.776099:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0ebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0eb4 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725886.776121:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5820:1875614935029760:0@lo:105: 00000100:00100000:0.0:1788725886.776146:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725886.776164:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1032900c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725886.776191:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935029760 00000100:00100000:0.0:1788725886.776195:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935029760 00000100:00100000:0.0:1788725886.776233:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788725886.776241:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5820:x1875614935029760:12345-0@lo:105: 00010000:00010000:0.0:1788725886.776249:0:5816:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.776256:0:5816:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.776264:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.776270:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.776277:0:5816:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.776295:0:5816:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff91a100031600) 00000100:00100000:0.0:1788725886.776327:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5820:x1875614935029760:12345-0@lo:105: Request processed in 86us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725886.776333:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788725886.776354:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.776369:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725886.776430:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935029888:0@lo:501: 00000100:00100000:0.0:1788725886.776677:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725886.776794:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935029504:0@lo:103: 00000100:00100000:1.0:1788725886.776807:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935029248:0@lo:103: 00000100:00100000:1.0:1788725886.776830:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10679c240 going to sleep for 11 seconds 00010000:00010000:1.0:1788725886.776842:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10149a200/0xcbde9110e47c0e52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0e4b expref: 14 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725886.776853:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935028864:0@lo:104: 00010000:00010000:1.0:1788725886.776861:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0de2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0ddb expref: 13 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725886.776869:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139864380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935028992:0@lo:104: 00010000:00010000:1.0:1788725886.776877:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100030e00/0xcbde9110e47c0dc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0dbf expref: 12 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725886.776885:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935029120:0@lo:104: 00010000:00010000:1.0:1788725886.776900:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725886.776908:0:5829:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725886.776913:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788725886.776921:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788725886.778029:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5820:1875614935029760:0@lo:105: 00010000:00010000:0.0:1788725886.778050:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.778060:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10149b200/0xcbde9110e47c0ead lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.778073:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725886.778125:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:3307:x1875614935029632:12345-0@lo:103: Request processed in 2178us (2250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725886.778134:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788725886.778170:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935029632:0@lo:103: 00000100:00100000:0.0:1788725886.778200:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a103290c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788725886.784197:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935029888 00000100:00100000:2.0:1788725886.784230:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935029888 00000100:00100000:2.0:1788725886.784299:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788725886.784311:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:5831:x1875614935029888:12345-0@lo:501: 00000100:00100000:2.0:1788725886.784776:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:5831:x1875614935029888:12345-0@lo:501: Request processed in 466us (8097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725886.785574:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788725886.789886:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935029888:0@lo:501: 00000100:00100000:3.0:1788725886.789949:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935030016:0@lo:503: 00000100:00100000:3.0:1788725886.790030:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725886.791303:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788725886.793985:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935030016 00000100:00100000:0.0:1788725886.793999:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935030016 00000100:00100000:0.0:1788725886.794055:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788725886.794065:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:5831:x1875614935030016:12345-0@lo:503: 00000100:00100000:0.0:1788725886.794317:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:5831:x1875614935030016:12345-0@lo:503: Request processed in 253us (4286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725886.794325:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788725886.794670:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935030016:0@lo:503: 00000100:00100000:3.0:1788725886.795957:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6696:1875614935030144:0@lo:502: 00000100:00100000:3.0:1788725886.796024:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725886.796066:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788725886.796281:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935030144 00000100:00100000:0.0:1788725886.796294:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935030144 00000100:00100000:0.0:1788725886.796327:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788725886.796335:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:6696:x1875614935030144:12345-0@lo:502: 00000100:00100000:0.0:1788725886.796564:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:6696:x1875614935030144:12345-0@lo:502: Request processed in 228us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725886.796572:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788725886.796911:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6696:1875614935030144:0@lo:502: 00000100:00100000:1.0:1788725886.796962:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6696:1875614935030272:0@lo:502: 00000100:00100000:1.0:1788725886.797001:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725886.797023:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10679c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788725886.797120:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935030272 00000100:00100000:0.0:1788725886.797125:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935030272 00000100:00100000:0.0:1788725886.797148:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788725886.797156:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:6696:x1875614935030272:12345-0@lo:502: 00000100:00100000:0.0:1788725886.797346:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:6696:x1875614935030272:12345-0@lo:502: Request processed in 190us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725886.797353:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788725886.797502:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6696:1875614935030272:0@lo:502: 00000040:00080000:1.0:1788725886.797523:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788725886.798042:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788725886.798060:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788725886.798070:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.798082:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725886.798092:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788725886.798096:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788725886.798099:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788725886.798127:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c0ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.798135:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c0ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.798157:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c0ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725886.798172:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935030400:0@lo:101: 00000100:00100000:0.0:1788725886.798252:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725886.798277:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a103290c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788725886.798290:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935030400 00000100:00100000:0.0:1788725886.798294:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935030400 00000100:00100000:0.0:1788725886.798320:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788725886.798328:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:5831:x1875614935030400:12345-0@lo:101: 00010000:00010000:0.0:1788725886.798338:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725886.798350:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0ec9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0ec2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.798373:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0ec2 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.798383:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0ec2 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.798570:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100031a00, rc 0) 00000100:00100000:0.0:1788725886.798758:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5831:x1875614935030400:12345-0@lo:101: Request processed in 429us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725886.798765:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788725886.802543:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935030400:0@lo:101: 00010000:00010000:3.0:1788725886.802591:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c0ec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0ec9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725886.802617:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c0ec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0ec9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725886.802970:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935030528:0@lo:501: 00000100:00100000:3.0:1788725886.803033:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725886.803075:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725886.803100:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935030528 00000100:00100000:3.0:1788725886.803106:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935030528 00000100:00100000:3.0:1788725886.803143:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788725886.803152:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5831:x1875614935030528:12345-0@lo:501: 00000100:00100000:3.0:1788725886.803908:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5831:x1875614935030528:12345-0@lo:501: Request processed in 754us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725886.803917:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788725886.808752:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935030528:0@lo:501: 00000100:00100000:0.0:1788725886.808830:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935030656:0@lo:503: 00000100:00100000:0.0:1788725886.808925:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725886.808968:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a112994d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788725886.808999:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935030656 00000100:00100000:0.0:1788725886.809005:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935030656 00000100:00100000:0.0:1788725886.809052:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788725886.809061:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5831:x1875614935030656:12345-0@lo:503: 00000100:00100000:0.0:1788725886.809265:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5831:x1875614935030656:12345-0@lo:503: Request processed in 204us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725886.809273:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788725886.809320:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935030656:0@lo:503: 00000100:00100000:0.0:1788725886.809540:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6697:1875614935030784:0@lo:502: 00000100:00100000:0.0:1788725886.809573:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725886.809592:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935030784 00000100:00100000:0.0:1788725886.809595:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935030784 00000100:00100000:0.0:1788725886.809614:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788725886.809620:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:6697:x1875614935030784:12345-0@lo:502: 00000100:00100000:0.0:1788725886.809767:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:6697:x1875614935030784:12345-0@lo:502: Request processed in 146us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725886.809773:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788725886.809802:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a112994d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788725886.809814:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6697:1875614935030784:0@lo:502: 00000020:01000000:0.0:1788725886.809836:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788725886.809845:0:6697:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788725886.809851:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725886.809854:0:6697:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788725886.809860:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788725886.809868:0:6697:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:01000000:0.0:1788725886.809895:0:6697:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788725886.809897:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788725886.809913:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91a11296b370) 00000020:00000080:0.0:1788725886.809935:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:0.0:1788725886.809940:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788725886.810020:0:6697:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788725886.810025:0:6697:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788725886.810033:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbde9110e47c0ed7 00010000:00080000:0.0:1788725886.810069:0:6697:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a005174800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:0.0:1788725886.810340:0:6697:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788725886.876932:0:6697:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788725886.876959:0:6697:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788725886.877728:0:6697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788725886.877984:0:6697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788725886.878035:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788725886.878197:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788725886.883031:0:6698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788725886.883041:0:6698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788725886.883912:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788725886.883927:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788725886.883959:0:6697:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788725886.883980:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbde9110e47c0ede 00000100:00080000:1.0:1788725886.883991:0:6697:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788725886.883996:0:6697:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91a005174800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788725886.884031:0:6697:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a139865f80 x1875614935030912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788725886.884060:0:6697:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788725886.884119:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725886.884123:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725886.884125:0:6697:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788725886.884128:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788725886.884133:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725886.884134:0:6697:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788725886.884138:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788725886.884139:0:6697:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788725886.884167:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139864380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6697:1875614935031040:0@lo:502: 00000100:00100000:1.0:1788725886.884280:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725886.884327:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1111c7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788725886.884594:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935030912:0@lo:8: 00000100:00100000:0.0:1788725886.884641:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725886.884688:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935031040 00000100:00100000:0.0:1788725886.884696:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935031040 00000100:00100000:0.0:1788725886.884734:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788725886.884743:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:6697:x1875614935031040:12345-0@lo:502: 00000100:00100000:0.0:1788725886.884978:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:6697:x1875614935031040:12345-0@lo:502: Request processed in 235us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725886.884987:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788725886.885063:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139864380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6697:1875614935031040:0@lo:502: 00000020:01000000:0.0:1788725886.885093:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725886.885098:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725886.885100:0:6697:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788725886.885104:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788725886.885243:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788725886.885261:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788725886.885269:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c0ec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0ec9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.885288:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c0ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0ec9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725886.885298:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788725886.885300:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91a103273370 from 1 10000000:01000000:0.0:1788725886.885303:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788725886.885328:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.885336:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.885345:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725886.885360:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935031168:0@lo:101: 00000100:00100000:0.0:1788725886.885399:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725886.885415:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1111c7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788725886.885427:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935031168 00000100:00100000:0.0:1788725886.885431:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935031168 00000100:00100000:0.0:1788725886.885637:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788725886.885645:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5831:x1875614935031168:12345-0@lo:101: 00010000:00010000:0.0:1788725886.885654:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725886.885667:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a100030400/0xcbde9110e47c0eec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0ee5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.885687:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a100030400/0xcbde9110e47c0eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0ee5 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.885709:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a100030400/0xcbde9110e47c0eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0ee5 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.885719:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100030400, rc 0) 00000100:00100000:0.0:1788725886.885750:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:5831:x1875614935031168:12345-0@lo:101: Request processed in 107us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725886.885756:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788725886.885801:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935031168:0@lo:101: 00010000:00010000:0.0:1788725886.885814:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.885824:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725886.885866:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935031296:0@lo:501: 00000100:00100000:0.0:1788725886.885892:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725886.885905:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1111c7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788725886.885916:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935031296 00000100:00100000:0.0:1788725886.885919:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935031296 00000100:00100000:0.0:1788725886.885939:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788725886.885945:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:5831:x1875614935031296:12345-0@lo:501: 00000100:00100000:0.0:1788725886.886153:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:5831:x1875614935031296:12345-0@lo:501: Request processed in 207us (261us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788725886.886160:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788725886.886201:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935031296:0@lo:501: 10000000:01000000:0.0:1788725886.886254:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788725886.886268:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.886275:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725886.886548:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935030912 00000100:00100000:1.0:1788725886.886554:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935030912 00000100:00100000:1.0:1788725886.886587:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788725886.886593:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875614935030912:12345-0@lo:8: 00010000:00020000:1.0:1788725886.886611:0:6680:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788725886.886653:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875614935030912:12345-0@lo:8: Request processed in 60us (2012us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788725886.886660:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788725886.886842:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a005174800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788725886.886848:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788725886.886851:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935030912:0@lo:8: 00000100:00100000:0.0:1788725886.887694:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935031424:0@lo:400: 00000100:00100000:0.0:1788725886.887739:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725886.888051:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935031424 00000100:00100000:3.0:1788725886.888067:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935031424 00000100:00100000:3.0:1788725886.888113:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788725886.888205:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935031424:12345-0@lo:400: 00000100:00100000:3.0:1788725886.888286:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935031424:12345-0@lo:400: Request processed in 83us (546us total) trans 0 rc 0/0 00010000:00080000:1.0:1788725886.888344:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a1111d9f80 x1875614935031424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725886.888357:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935031424:0@lo:400: 00000100:00100000:3.0:1788725886.890676:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788725886.972922:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:6678:x1875614935028736:12345-0@lo:253: Request processed in 218212us (218555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725886.972935:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788725886.975960:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935028736:0@lo:253: 10000000:01000000:2.0:1788725886.975982:0:6678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788725886.975985:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788725886.975987:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788725886.975988:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788725886.975990:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788725886.975991:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788725886.975992:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788725886.975993:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788725886.975995:0:6678:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788725886.975997:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788725886.975998:0:6678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788725886.976306:0:6678:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91a10338f800 from lustre-OST0000 10000000:01000000:3.0:1788725886.976335:0:6678:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788725886.976338:0:6678:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788725886.976345:0:6678:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91a103273370 local copy 00010000:00010000:3.0:1788725886.976355:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725886.976770:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935031552:0@lo:501: 00000100:00100000:3.0:1788725886.978167:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725886.978313:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788725886.979707:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935031552 00000100:00100000:0.0:1788725886.979719:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935031552 00000100:00100000:0.0:1788725886.979778:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788725886.979934:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:6678:x1875614935031552:12345-0@lo:501: 00000100:00100000:0.0:1788725886.980239:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:6678:x1875614935031552:12345-0@lo:501: Request processed in 282us (2049us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788725886.980428:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935031552:0@lo:501: 10000000:01000000:3.0:1788725886.980460:0:6678:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788725886.980493:0:6678:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788725886.980502:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725886.980512:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725886.980549:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91a10338f800 10000000:01000000:3.0:1788725886.980552:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788725886.980557:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91a103273370 10000000:01000000:3.0:1788725886.980560:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788725886.980575:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff91a103273370 from 1 10000000:01000000:3.0:1788725886.980578:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788725886.980617:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71800/0xcbde9110e47c0ef3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725886.980624:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10db71800/0xcbde9110e47c0ef3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725886.980632:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10db71800/0xcbde9110e47c0ef3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725886.980650:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935031680:0@lo:101: 00000100:00100000:3.0:1788725886.980997:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725886.981036:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788725886.982403:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935031680 00000100:00100000:1.0:1788725886.982415:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935031680 00000100:00100000:0.0:1788725886.983199:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788725886.983985:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788725886.984000:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:6678:x1875614935031680:12345-0@lo:101: 00010000:00010000:0.0:1788725886.984019:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725886.984039:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a100031400/0xcbde9110e47c0efa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0ef3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.984064:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a100031400/0xcbde9110e47c0efa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0ef3 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.984075:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a100031400/0xcbde9110e47c0efa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0ef3 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725886.984098:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100031400, rc 0) 00000100:00100000:0.0:1788725886.984196:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:6678:x1875614935031680:12345-0@lo:101: Request processed in 201us (3199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725886.984202:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788725886.984313:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935031680:0@lo:101: 00010000:00010000:3.0:1788725886.984332:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10db71800/0xcbde9110e47c0ef3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0efa expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725886.984342:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10db71800/0xcbde9110e47c0ef3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0efa expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725886.984363:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788725886.984392:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71800/0xcbde9110e47c0ef3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0efa expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725886.984411:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10db71800/0xcbde9110e47c0ef3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0efa expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725886.984420:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788725886.984425:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788725886.984441:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788725886.984444:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788725886.984470:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c0f01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725886.984479:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c0f01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725886.984487:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c0f01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725886.984505:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935031808:0@lo:101: 00000100:00100000:3.0:1788725886.984539:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725886.985111:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788725886.985313:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935031808 00000100:00100000:2.0:1788725886.985321:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935031808 00000100:00100000:2.0:1788725886.985356:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788725886.985365:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:6678:x1875614935031808:12345-0@lo:101: 00010000:00010000:2.0:1788725886.985375:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725886.985398:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e725000/0xcbde9110e47c0f08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0f01 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725886.985416:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e725000/0xcbde9110e47c0f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0f01 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725886.985426:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e725000/0xcbde9110e47c0f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0f01 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725886.985550:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725000, rc 0) 00000100:00100000:2.0:1788725886.985873:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:6678:x1875614935031808:12345-0@lo:101: Request processed in 509us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725886.985880:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788725886.985984:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935031808:0@lo:101: 00010000:00010000:3.0:1788725886.985998:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c0f01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0f08 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725886.986006:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c0f01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0f08 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725886.986127:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935031936:0@lo:501: 00000100:00100000:3.0:1788725886.986190:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725886.986284:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788725886.986380:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935031936 00000100:00100000:1.0:1788725886.986510:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935031936 00000100:00100000:0.0:1788725886.986945:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788725886.986955:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:6678:x1875614935031936:12345-0@lo:501: 00000100:00100000:0.0:1788725886.987245:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:6678:x1875614935031936:12345-0@lo:501: Request processed in 291us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725886.987254:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788725886.987328:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935031936:0@lo:501: 00000100:00100000:1.0:1788725886.987368:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032064:0@lo:503: 00000100:00100000:1.0:1788725886.987426:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725886.987948:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1128c3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788725886.988051:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935032064 00000100:00100000:3.0:1788725886.988058:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935032064 00000100:00100000:3.0:1788725886.988087:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788725886.988096:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:6678:x1875614935032064:12345-0@lo:503: 00000100:00100000:3.0:1788725886.988305:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:6678:x1875614935032064:12345-0@lo:503: Request processed in 209us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725886.988312:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788725886.988419:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032064:0@lo:503: 00000040:00080000:1.0:1788725886.989083:0:6678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788725886.989150:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032192:0@lo:502: 00000100:00100000:1.0:1788725886.989211:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725886.989276:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1128c3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788725886.989350:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935032192 00000100:00100000:3.0:1788725886.989357:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935032192 00000100:00100000:3.0:1788725886.989380:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788725886.989387:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:6678:x1875614935032192:12345-0@lo:502: 00000100:00100000:3.0:1788725886.989554:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:6678:x1875614935032192:12345-0@lo:502: Request processed in 166us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725886.989561:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788725886.990041:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032192:0@lo:502: 00000040:00080000:1.0:1788725886.990338:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788725886.990410:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788725886.990456:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788725886.990506:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788725886.990543:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788725886.990587:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788725886.990947:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032320:0@lo:502: 00000100:00100000:1.0:1788725886.991001:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725886.991031:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1128c3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788725886.991200:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935032320 00000100:00100000:3.0:1788725886.991207:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935032320 00000100:00100000:3.0:1788725886.991263:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788725886.991270:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:6678:x1875614935032320:12345-0@lo:502: 00000100:00100000:3.0:1788725886.991448:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:6678:x1875614935032320:12345-0@lo:502: Request processed in 177us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725886.991456:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788725886.991877:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032320:0@lo:502: 00000040:00080000:1.0:1788725886.991984:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788725886.991995:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788725886.992647:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788725886.992655:0:6701:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788725886.992661:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725886.992663:0:6701:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788725886.992676:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788725886.992691:0:6701:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff91a1111d19b8) 00000020:00000080:1.0:1788725886.992710:0:6701:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788725886.992716:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788725886.992960:0:6701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a10338f800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788725886.992969:0:6701:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788725886.992977:0:6701:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcbde9110e47c0f16 00010000:00010000:0.0:1788725886.997384:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725886.998875:0:6701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788725886.999193:0:6701:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788725887.003195:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788725887.004558:0:6701:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788725887.015193:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788725887.016278:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788725887.018605:0:6701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788725887.018618:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725887.018633:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725887.018635:0:6701:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788725887.018640:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788725887.018644:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725887.018645:0:6701:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788725887.018649:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788725887.018651:0:6701:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788725887.018708:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725887.018712:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725887.018714:0:6701:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788725887.018717:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788725887.019060:0:6678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788725887.019086:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788725887.019108:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c0f01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0f08 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.019120:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c0f01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0f08 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725887.019134:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a10338f800 from 1 10000000:01000000:1.0:1788725887.019137:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788725887.019170:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10149a200/0xcbde9110e47c0f1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.019189:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10149a200/0xcbde9110e47c0f1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.019200:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10149a200/0xcbde9110e47c0f1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725887.019249:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032448:0@lo:101: 00000100:00100000:1.0:1788725887.019308:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725887.019349:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a104b58240 going to sleep for 11 seconds 00000100:00100000:2.0:1788725887.019895:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935032448 00000100:00100000:2.0:1788725887.019904:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935032448 00000100:00100000:2.0:1788725887.019949:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788725887.019957:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:6678:x1875614935032448:12345-0@lo:101: 00010000:00010000:2.0:1788725887.019972:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725887.019985:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c0f24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0f1d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.020006:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c0f24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0f1d expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.020016:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c0f24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0f1d expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.020025:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724c00, rc 0) 00000100:00100000:2.0:1788725887.020062:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:6678:x1875614935032448:12345-0@lo:101: Request processed in 106us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725887.020068:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788725887.020253:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032448:0@lo:101: 00010000:00010000:1.0:1788725887.020267:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10149a200/0xcbde9110e47c0f1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0f24 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.020276:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10149a200/0xcbde9110e47c0f1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0f24 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725887.020362:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032576:0@lo:501: 00000100:00100000:1.0:1788725887.020396:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725887.020418:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a104b58240 going to sleep for 11 seconds 00000100:00100000:0.0:1788725887.020521:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935032576 00000100:00100000:0.0:1788725887.020525:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935032576 00000100:00100000:0.0:1788725887.020552:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788725887.020559:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:6678:x1875614935032576:12345-0@lo:501: 00000100:00100000:0.0:1788725887.020963:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:6678:x1875614935032576:12345-0@lo:501: Request processed in 404us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725887.020970:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788725887.021122:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032576:0@lo:501: 00000100:00100000:1.0:1788725887.021150:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032704:0@lo:503: 00000100:00100000:1.0:1788725887.021202:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725887.021258:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a104b58240 going to sleep for 11 seconds 00000100:00100000:0.0:1788725887.021336:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935032704 00000100:00100000:0.0:1788725887.021340:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935032704 00000100:00100000:0.0:1788725887.021368:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788725887.021375:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:6678:x1875614935032704:12345-0@lo:503: 00000100:00100000:2.0:1788725887.021877:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032704:0@lo:503: 00000040:00080000:2.0:1788725887.022122:0:6678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788725887.022189:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032832:0@lo:502: 00000100:00100000:0.0:1788725887.022338:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:6678:x1875614935032704:12345-0@lo:503: Request processed in 962us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725887.022347:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788725887.025908:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725887.025969:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a103348000 going to sleep for 11 seconds 00000100:00100000:3.0:1788725887.026088:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935032832 00000100:00100000:3.0:1788725887.026098:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935032832 00000100:00100000:3.0:1788725887.026152:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788725887.026162:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:6678:x1875614935032832:12345-0@lo:502: 00000100:00100000:3.0:1788725887.026636:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:6678:x1875614935032832:12345-0@lo:502: Request processed in 474us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725887.026645:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788725887.026959:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032832:0@lo:502: 00000040:00080000:2.0:1788725887.027297:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788725887.027350:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788725887.027504:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032960:0@lo:502: 00000100:00100000:2.0:1788725887.027551:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725887.027595:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a103348000 going to sleep for 11 seconds 00000100:00100000:1.0:1788725887.027912:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935032960 00000100:00100000:1.0:1788725887.027920:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935032960 00000100:00100000:1.0:1788725887.027957:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788725887.027966:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:6678:x1875614935032960:12345-0@lo:502: 00000100:00100000:1.0:1788725887.028124:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:6678:x1875614935032960:12345-0@lo:502: Request processed in 158us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.028132:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788725887.028373:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935032960:0@lo:502: 00000040:00080000:2.0:1788725887.028636:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788725887.028648:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788725887.033485:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788725887.033499:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725887.033501:0:6705:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788725887.033509:0:6705:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a10338f800 00000020:00000080:0.0:1788725887.033511:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788725887.033527:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725887.033530:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725887.033532:0:6705:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788725887.033535:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788725887.033984:0:6678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788725887.034012:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788725887.034032:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10149a200/0xcbde9110e47c0f1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0f24 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.034045:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10149a200/0xcbde9110e47c0f1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0f24 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725887.034086:0:6678:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788725887.034089:0:6678:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91a10338f800 10000000:01000000:1.0:1788725887.034092:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91a10338f800 10000000:01000000:1.0:1788725887.034096:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788725887.034102:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91a10338f800 from 1 10000000:01000000:1.0:1788725887.034104:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788725887.034139:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.034147:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.034157:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725887.034199:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139864700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935033088:0@lo:101: 00000100:00100000:1.0:1788725887.034284:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725887.034327:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935033088 00000100:00100000:1.0:1788725887.034334:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935033088 00000100:00100000:1.0:1788725887.034371:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788725887.034380:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:6678:x1875614935033088:12345-0@lo:101: 00010000:00010000:1.0:1788725887.034393:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725887.034404:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10149aa00/0xcbde9110e47c0f32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0f2b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.034425:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10149aa00/0xcbde9110e47c0f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0f2b expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.034448:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10149aa00/0xcbde9110e47c0f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0f2b expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.034458:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10149aa00, rc 0) 00000100:00100000:1.0:1788725887.034488:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:6678:x1875614935033088:12345-0@lo:101: Request processed in 110us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.034495:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788725887.034532:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1128a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725887.034552:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139864700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935033088:0@lo:101: 00010000:00010000:1.0:1788725887.034744:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0f32 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.034753:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0f32 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725887.034944:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139864700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935033216:0@lo:501: 00000100:00100000:1.0:1788725887.034971:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725887.034996:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1128a8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725887.035311:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935033216 00000100:00100000:3.0:1788725887.035318:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935033216 00000100:00100000:3.0:1788725887.035347:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788725887.035355:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:6678:x1875614935033216:12345-0@lo:501: 00000100:00100000:3.0:1788725887.035867:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:6678:x1875614935033216:12345-0@lo:501: Request processed in 511us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725887.035875:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788725887.036108:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139864700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935033216:0@lo:501: 00000100:00100000:0.0:1788725887.036159:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935033344:0@lo:503: 00000100:00100000:0.0:1788725887.036248:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725887.036279:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a00512b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788725887.036346:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935033344 00000100:00100000:1.0:1788725887.036352:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935033344 00000100:00100000:1.0:1788725887.036377:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788725887.036396:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:6678:x1875614935033344:12345-0@lo:503: 00000100:00100000:1.0:1788725887.036938:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:6678:x1875614935033344:12345-0@lo:503: Request processed in 541us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.036947:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788725887.037049:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935033344:0@lo:503: 00000040:00080000:0.0:1788725887.037369:0:6678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788725887.037948:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935033472:0@lo:502: 00000100:00100000:0.0:1788725887.038001:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725887.038040:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a00512b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788725887.038098:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935033472 00000100:00100000:1.0:1788725887.038104:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935033472 00000100:00100000:1.0:1788725887.038143:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788725887.038151:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:6678:x1875614935033472:12345-0@lo:502: 00000100:00100000:1.0:1788725887.038380:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:6678:x1875614935033472:12345-0@lo:502: Request processed in 229us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.038401:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788725887.040434:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935033472:0@lo:502: 00000040:00080000:0.0:1788725887.040879:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788725887.040945:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788725887.040980:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788725887.041029:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788725887.041068:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788725887.041116:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788725887.041152:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788725887.041198:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788725887.041274:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788725887.041313:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788725887.041346:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788725887.041390:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788725887.041426:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788725887.041461:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788725887.041523:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788725887.041560:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788725887.041594:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788725887.041643:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788725887.043354:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788725887.043434:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788725887.043504:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788725887.043539:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788725887.043572:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788725887.043637:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788725887.043679:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788725887.043710:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788725887.043760:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788725887.044034:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788725887.044088:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935033600:0@lo:502: 00000100:00100000:0.0:1788725887.044207:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725887.044553:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a00512b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788725887.047911:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935033600 00000100:00100000:2.0:1788725887.047928:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935033600 00000100:00100000:2.0:1788725887.047986:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788725887.047997:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:6678:x1875614935033600:12345-0@lo:502: 00000100:00100000:2.0:1788725887.048298:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:6678:x1875614935033600:12345-0@lo:502: Request processed in 302us (4090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725887.048307:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788725887.048438:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935033600:0@lo:502: 00000040:00080000:0.0:1788725887.048551:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788725887.048565:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788725887.050013:0:6706:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788725887.050030:0:6706:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91a11296cd28) 00000020:00000080:0.0:1788725887.050052:0:6706:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lwp with refcount 2 00000020:01000004:0.0:1788725887.050379:0:6706:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a10338f800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788725887.050384:0:6706:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a10338f800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788725887.050387:0:6706:0:(obd_mount.c:721:lustre_put_lsi()) put ffff91a10338f800 3 00010000:00080000:0.0:1788725887.050415:0:6706:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a13adc3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.142@tcp at head 00010000:00010000:1.0:1788725887.062013:0:6706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-3 is initialized 00000020:00000080:1.0:1788725887.062252:0:6706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788725887.062309:0:6706:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788725887.062325:0:6706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcbde9110e47c0f40 00000100:00080000:1.0:1788725887.062336:0:6706:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788725887.062342:0:6706:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91a13adc3800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788725887.062377:0:6706:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a139867100 x1875614935033728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788725887.062474:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875614935033728:0@lo:38: 00000100:00100000:3.0:1788725887.062550:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788725887.063763:0:6706:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788725887.066945:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788725887.066954:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788725887.066958:0:8:0:(import.c:65:import_set_state_nolock()) ffff91a005174800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788725887.066968:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 181 00000100:00080000:2.0:1788725887.066974:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788725887.066980:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91a005174800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788725887.067002:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a13b17d180 x1875614935033984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788725887.069120:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935033856:0@lo:400: 00000100:00100000:1.0:1788725887.069234:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725887.069301:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935033728 00000100:00100000:1.0:1788725887.069310:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935033728 00000100:00100000:1.0:1788725887.069350:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935033856 00000100:00100000:1.0:1788725887.069354:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935033856 00000100:00100000:1.0:1788725887.069381:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788725887.069391:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935033856:12345-0@lo:400: 00000100:00100000:1.0:1788725887.069468:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935033856:12345-0@lo:400: Request processed in 77us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.069476:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788725887.069492:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788725887.069496:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1875614935033728:12345-0@lo:38: 00010000:00080000:1.0:1788725887.069519:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:1.0:1788725887.069550:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcbde9110e47c0f47 00000004:00100000:1.0:1788725887.069565:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788725887.069610:0:5835:0:(import.c:65:import_set_state_nolock()) ffff91a0052aa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788725887.069914:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935033984:0@lo:8: 00000100:00100000:3.0:1788725887.069950:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725887.077372:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875614935033728:12345-0@lo:38: Request processed in 7860us (14809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.077387:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788725887.077436:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935033984 00000100:00100000:1.0:1788725887.077446:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935033984 00000100:00100000:1.0:1788725887.077484:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788725887.077491:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3303:x1875614935033984:12345-0@lo:8: 00000100:00100000:1.0:1788725887.077570:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3303:x1875614935033984:12345-0@lo:8: Request processed in 78us (7619us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788725887.077576:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788725887.077659:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a13b17ed80 x1875614935033856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725887.077794:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935033856:0@lo:400: 00010000:00080000:3.0:1788725887.078029:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a139867100 x1875614935033728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788725897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725887.078039:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788725887.078049:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788725887.078058:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788725887.078064:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788725887.078067:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a13adc3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788725887.078075:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875614935033728:0@lo:38: 00000100:00100000:3.0:1788725887.078110:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788725887.078114:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a005174800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788725887.078118:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788725887.078129:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935033984:0@lo:8: 00000040:00080000:1.0:1788725887.078915:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788725887.083066:0:6678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788725887.083115:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788725887.083139:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0f32 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.083151:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0f32 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788725887.083407:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788725887.083410:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788725887.083411:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788725887.083412:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788725887.083413:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788725887.083414:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788725887.083416:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788725887.083417:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788725887.083419:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788725887.083420:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788725887.083422:0:6678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788725887.083425:0:6678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788725887.083428:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788725887.083429:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788725887.083430:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788725887.083431:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788725887.083432:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788725887.083433:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788725887.083435:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788725887.083436:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788725887.083437:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788725887.083438:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788725887.083439:0:6678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788725887.083464:0:6678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788725887.083484:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935034112:0@lo:253: 00000100:00100000:3.0:1788725887.083560:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725887.083634:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788725887.083687:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935034112 00000100:00100000:0.0:1788725887.083695:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935034112 00000100:00100000:0.0:1788725887.083738:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788725887.083746:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:6678:x1875614935034112:12345-0@lo:253: 20000000:01000000:0.0:1788725887.083773:0:5827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788725887.083786:0:5827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788725887.117194:0:5827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788725887.117233:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788725887.117342:0:5850:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788725887.117348:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788725887.117374:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0f4e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725887.117405:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10e725a00/0xcbde9110e47c0e7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0e75 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725887.117415:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0f4e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725887.117477:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10e725a00/0xcbde9110e47c0e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0e75 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725887.117491:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a10e725a00/0xcbde9110e47c0e7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0e75 expref: 16 pid: 5829 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725887.117505:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111dad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1875614935034240:0@lo:104: 00000100:00100000:3.0:1788725887.117568:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725887.117617:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725887.117794:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788725887.117821:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935034240 00000100:00100000:0.0:1788725887.117829:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935034240 00000100:00100000:0.0:1788725887.117880:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788725887.117889:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a112f66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5850:x1875614935034240:12345-0@lo:104: 00010000:00010000:0.0:1788725887.117901:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c0e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0e7c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.117953:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788725887.117960:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a112f66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5850:x1875614935034240:12345-0@lo:104: Request processed in 72us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725887.117966:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788725887.118013:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788725887.118019:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c0e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0e7c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118026:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725400 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788725887.118029:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c0e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0e7c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118037:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c0e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0e7c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725887.118044:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c0e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0e7c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725887.118049:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788725887.118075:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c0e75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0e7c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118081:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725887.118099:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c0e75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0e7c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118106:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c0e75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0e7c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118122:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725887.118124:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725887.118126:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725887.118290:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111dad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1875614935034240:0@lo:104: 00010000:00010000:3.0:1788725887.118309:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0f4e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725887.118580:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935034368:0@lo:103: 00000100:00100000:3.0:1788725887.118612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725887.118689:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935034368 00000100:00100000:0.0:1788725887.118694:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935034368 00010000:00010000:0.0:1788725887.118714:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10e725a00/0xcbde9110e47c0e7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0e75 expref: 17 pid: 5829 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725887.118767:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788725887.118775:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:3305:x1875614935034368:12345-0@lo:103: 00010000:00010000:0.0:1788725887.118787:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725887.118793:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10e725a00/0xcbde9110e47c0e7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0e75 expref: 17 pid: 5829 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118802:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10e725a00/0xcbde9110e47c0e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0e75 expref: 17 pid: 5829 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118815:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e725a00/0xcbde9110e47c0e7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0e75 expref: 17 pid: 5829 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118828:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0f4e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118835:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0f4e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788725887.118848:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001500924s 00010000:00010000:0.0:1788725887.118852:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0f4e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118857:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0f4e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118864:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0f4e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118870:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0f4e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118883:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10db70000 already unused, calling callback (ffffffffc142a230) 00010000:00010000:0.0:1788725887.118888:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0f4e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118895:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0f4e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118907:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0f4e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725887.118915:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725887.118944:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:3305:x1875614935034368:12345-0@lo:103: Request processed in 170us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725887.118950:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788725887.119068:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935034368:0@lo:103: 00010000:00010000:3.0:1788725887.119086:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0f4e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725887.119094:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0f4e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725887.119100:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0f4e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725887.130834:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:6678:x1875614935034112:12345-0@lo:253: Request processed in 47079us (47265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725887.130865:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788725887.130993:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:6678:1875614935034112:0@lo:253: 10000000:01000000:0.0:1788725887.131010:0:6678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788725887.131013:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788725887.131015:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788725887.131017:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788725887.131018:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788725887.131019:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788725887.131020:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788725887.131022:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788725887.131024:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788725887.131026:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788725887.131027:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788725887.131029:0:6678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788725887.131048:0:6678:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788725887.136184:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788725887.136405:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788725887.136867:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788725887.137069:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788725887.137700:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788725887.137945:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788725887.139409:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788725887.499266:0:6678:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788725887.499273:0:6678:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788725887.499303:0:6678:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788725887.499360:0:6678:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788725887.499387:0:6678:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788725887.499415:0:6678:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788725888.021938:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725889.046286:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725890.073893:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725891.093520:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725892.126418:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788725892.310126:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788725892.310138:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788725892.310141:0:8:0:(import.c:65:import_set_state_nolock()) ffff91a005174800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788725892.310154:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91a005174800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788725892.310177:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a13b17d880 x1875614935034752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788725892.310255:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935034624:0@lo:400: 00000100:00100000:2.0:1788725892.310324:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725892.310402:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725892.310408:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935034496:0@lo:400: 00000100:00100000:2.0:1788725892.310437:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725892.310472:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935034752:0@lo:8: 00000100:00100000:2.0:1788725892.310501:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725892.310532:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935034880:0@lo:400: 00000100:00100000:2.0:1788725892.310556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725892.310617:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935034624 00000100:00100000:2.0:1788725892.310625:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935034624 00000100:00100000:2.0:1788725892.310660:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935034880 00000100:00100000:2.0:1788725892.310663:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935034880 00000100:00100000:2.0:1788725892.310686:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788725892.310692:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935034624:12345-0@lo:400: 00000100:00100000:2.0:1788725892.310741:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935034624:12345-0@lo:400: Request processed in 48us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725892.310747:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788725892.310760:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788725892.310765:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935034880:12345-0@lo:400: 00000100:00100000:2.0:1788725892.310790:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935034880:12345-0@lo:400: Request processed in 25us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725892.310795:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788725892.310809:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935034496 00000100:00100000:2.0:1788725892.310813:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935034496 00000100:00100000:2.0:1788725892.310833:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788725892.310838:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:3307:x1875614935034496:12345-0@lo:400: 00000100:00100000:2.0:1788725892.310862:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:3307:x1875614935034496:12345-0@lo:400: Request processed in 25us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725892.310868:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788725892.310896:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935034752 00000100:00100000:2.0:1788725892.310900:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935034752 00000100:00100000:2.0:1788725892.310918:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788725892.310922:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1875614935034752:12345-0@lo:8: 00010000:00080000:2.0:1788725892.310943:0:6682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:2.0:1788725892.310969:0:6682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbde9110e47c0f55 00002000:00100000:2.0:1788725892.311009:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91a13f442000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788725892.311018:0:6682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788725892.311022:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788725892.311154:0:6682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788725892.311323:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788725892.311346:0:6682:0:(import.c:65:import_set_state_nolock()) ffff91a13f442800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725892.311386:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875614935034752:12345-0@lo:8: Request processed in 462us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725892.311391:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788725892.311433:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a13b17d880 x1875614935034752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788725907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788725892.311449:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788725892.311457:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788725892.311463:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788725892.311465:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a005174800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788725892.311475:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788725892.311479:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935034752:0@lo:8: 00010000:00080000:2.0:1788725892.311506:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a13b17dc00 x1875614935034880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725892.311514:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935034880:0@lo:400: 00000100:00100000:2.0:1788725892.311529:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935034496:0@lo:400: 00010000:00080000:2.0:1788725892.311538:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a13b17ce00 x1875614935034624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725892.311546:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935034624:0@lo:400: 00000100:00080000:1.0:1788725892.311767:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788725892.311778:0:6698:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788725892.312201:0:6698:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 187361984008ns, next at 0ns, rc = 0 10000000:01000000:2.0:1788725892.324688:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788725892.324696:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91a120292000 from 4 10000000:01000000:2.0:1788725892.324717:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788725892.324772:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c0f5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725892.324784:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c0f5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725892.324795:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c0f5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725892.324819:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935035008:0@lo:101: 00000100:00100000:2.0:1788725892.324890:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725892.324950:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10408a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788725892.327874:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935035008 00000100:00100000:0.0:1788725892.327889:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935035008 00000100:00100000:0.0:1788725892.327946:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788725892.327957:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:5831:x1875614935035008:12345-0@lo:101: 00010000:00010000:0.0:1788725892.327975:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725892.327996:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a100031800/0xcbde9110e47c0f63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0f5c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725892.328022:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a100031800/0xcbde9110e47c0f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0f5c expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725892.328034:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a100031800/0xcbde9110e47c0f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0f5c expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725892.328044:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100031800, rc 0) 00000100:00100000:0.0:1788725892.328136:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935035008:12345-0@lo:101: Request processed in 182us (3246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725892.328155:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788725892.328256:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935035008:0@lo:101: 00010000:00010000:0.0:1788725892.328273:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c0f5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0f63 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725892.328283:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c0f5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0f63 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725892.328451:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935035136:0@lo:256: 00000100:00100000:0.0:1788725892.328490:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725892.328519:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1088c5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788725892.328534:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935035136 00000100:00100000:0.0:1788725892.328538:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935035136 00000100:00100000:0.0:1788725892.328565:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788725892.328572:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935035136:12345-0@lo:256: 20000000:01000000:0.0:1788725892.328585:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788725892.328601:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788725892.328680:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788725892.328753:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935035136:12345-0@lo:256: Request processed in 181us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725892.328760:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788725892.328793:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935035136:0@lo:256: 10000000:01000000:0.0:1788725892.328847:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788725892.328854:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c0f5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0f63 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725892.328861:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c0f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0f63 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788725892.403802:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788725892.487276:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935035264:0@lo:13: 00000100:00100000:0.0:1788725892.487446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725892.487556:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935035264 00000100:00100000:1.0:1788725892.487564:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935035264 00000100:00100000:1.0:1788725892.487618:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788725892.487628:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875614935035264:12345-0@lo:13: 00002000:00000024:1.0:1788725892.487662:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000004:00080000:3.0:1788725892.487774:0:6699:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788725892.487795:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6699:1875614935035392:0@lo:7: 00000100:00100000:3.0:1788725892.487821:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725892.487843:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788725892.487878:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935035392 00000100:00100000:3.0:1788725892.487882:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935035392 00000100:00100000:3.0:1788725892.487910:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788725892.487916:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6699:x1875614935035392:12345-0@lo:7: 00000100:00100000:1.0:1788725892.494894:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875614935035264:12345-0@lo:13: Request processed in 7256us (7437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725892.494910:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788725892.494948:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788725892.496187:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788725892.496194:0:6680:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788725892.496311:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6699:x1875614935035392:12345-0@lo:7: Request processed in 8392us (8486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725892.496321:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788725892.497239:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1111dbb80 x1875614935035392/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788725908 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725892.497673:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6699:1875614935035392:0@lo:7: 00000004:00080000:2.0:1788725892.497690:0:6699:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788725892.498642:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6699:1875614935035520:0@lo:5: 00000100:00100000:3.0:1788725892.498710:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725892.498754:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788725892.498773:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935035520 00000100:00100000:3.0:1788725892.498779:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935035520 00000100:00100000:3.0:1788725892.498827:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788725892.498836:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6699:x1875614935035520:12345-0@lo:5: 00002000:00080000:3.0:1788725892.498875:0:6683:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788725892.498879:0:6683:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788725892.499194:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6699:x1875614935035520:12345-0@lo:5: Request processed in 358us (483us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788725892.499201:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788725892.499279:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1111dbb80 x1875614935035520/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788725908 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725892.499294:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6699:1875614935035520:0@lo:5: 00000004:00080000:3.0:1788725892.499305:0:6699:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00010000:00080000:0.0:1788725892.503826:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1111da300 x1875614935035264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725892.503854:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935035264:0@lo:13: 00000001:00100000:1.0:1788725892.895027:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788725892.895043:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00010000:0.0:1788725893.141365:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725894.177398:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788725894.220706:0:7051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788725895.190730:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725896.214533:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725897.239942:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725897.429471:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935035776:0@lo:400: 00000100:00100000:2.0:1788725897.429547:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725897.429610:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725897.429617:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935035648:0@lo:400: 00000100:00100000:2.0:1788725897.429646:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725897.429675:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935035904:0@lo:400: 00000100:00100000:2.0:1788725897.429700:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725897.429719:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788725897.429724:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935036032:0@lo:400: 00000100:00100000:2.0:1788725897.429758:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725897.429786:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935035776 00000100:00100000:2.0:1788725897.429793:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935035776 00000100:00100000:2.0:1788725897.429833:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935036032 00000100:00100000:2.0:1788725897.429835:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935036032 00000100:00100000:2.0:1788725897.429861:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788725897.429869:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935035776:12345-0@lo:400: 00000100:00100000:2.0:1788725897.429919:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935035776:12345-0@lo:400: Request processed in 49us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725897.429925:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788725897.429940:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788725897.429947:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935036032:12345-0@lo:400: 00000100:00100000:2.0:1788725897.429976:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935036032:12345-0@lo:400: Request processed in 30us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725897.429982:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788725897.430015:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788725897.430041:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a13b17c380 x1875614935036032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725897.430054:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935036032:0@lo:400: 00010000:00080000:2.0:1788725897.430081:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a13b17dc00 x1875614935035776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725897.430089:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935035776:0@lo:400: 00000100:00100000:3.0:1788725897.430179:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935035904 00000100:00100000:3.0:1788725897.430184:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935035904 00000100:00100000:3.0:1788725897.430254:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788725897.430262:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935035904:12345-0@lo:400: 00000100:00100000:3.0:1788725897.430302:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935035904:12345-0@lo:400: Request processed in 42us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725897.430308:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788725897.430337:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a13b17d880 x1875614935035904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725897.430345:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788725897.430356:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935035904:0@lo:400: 00000100:00080000:2.0:1788725897.431416:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725897.436488:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935035648 00000100:00100000:0.0:1788725897.436503:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935035648 00000100:00100000:0.0:1788725897.436562:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788725897.436571:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:3307:x1875614935035648:12345-0@lo:400: 00000100:00100000:0.0:1788725897.436667:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:3307:x1875614935035648:12345-0@lo:400: Request processed in 96us (7019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725897.436674:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788725897.436732:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935035648:0@lo:400: 00000100:00100000:3.0:1788725897.944161:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6699:1875614935036288:0@lo:700: 00000100:00100000:3.0:1788725897.944271:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725897.944321:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111795180 going to sleep for 11 seconds 00000100:00100000:3.0:1788725897.944348:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935036288 00000100:00100000:3.0:1788725897.944356:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935036288 00000100:00100000:3.0:1788725897.944403:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788725897.944413:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6699:x1875614935036288:12345-0@lo:700: 00000100:00100000:3.0:1788725897.944449:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111db480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6689:1875614935036416:0@lo:700: 00000100:00100000:3.0:1788725897.944480:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725897.944498:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111795840 going to sleep for 11 seconds 00000100:00100000:0.0:1788725897.944621:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935036160:0@lo:13: 00000100:00100000:0.0:1788725897.944653:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725897.944940:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935036160 00000100:00100000:3.0:1788725897.944945:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935036160 00000100:00100000:3.0:1788725897.944980:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788725897.944998:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875614935036160:12345-0@lo:13: 00002000:00000024:3.0:1788725897.945027:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788725897.945070:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875614935036160:12345-0@lo:13: Request processed in 83us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725897.945077:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788725897.945152:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1111dbb80 x1875614935036160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725897.945172:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935036160:0@lo:13: 00000100:00100000:3.0:1788725897.945409:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935036416 00000100:00100000:3.0:1788725897.945414:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935036416 00000100:00100000:3.0:1788725897.945450:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788725897.945459:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6689:x1875614935036416:12345-0@lo:700: 40000000:02000000:3.0:1788725897.998626:0:5841:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788725898.013494:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6689:x1875614935036416:12345-0@lo:700: Request processed in 68026us (69003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725898.013510:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788725898.013572:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1111db480 x1875614935036416/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788725913 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725898.013588:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111db480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6689:1875614935036416:0@lo:700: 40000000:02000000:3.0:1788725898.013602:0:6689:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1788725898.129506:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6699:x1875614935036288:12345-0@lo:700: Request processed in 185085us (185226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725898.129520:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788725898.129859:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1111db800 x1875614935036288/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788725913 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725898.129882:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6699:1875614935036288:0@lo:700: 00000004:02000040:0.0:1788725898.192508:0:6699:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788725898.195810:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6699:1875614935036544:0@lo:5: 00000100:00100000:0.0:1788725898.195894:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725898.195962:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1088c5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788725898.196064:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935036544 00000100:00100000:1.0:1788725898.196072:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935036544 00000100:00100000:1.0:1788725898.204319:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788725898.204339:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6699:x1875614935036544:12345-0@lo:5: 00002000:00080000:1.0:1788725898.212121:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788725898.212140:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788725898.227561:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6699:x1875614935036544:12345-0@lo:5: Request processed in 23220us (31658us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788725898.227574:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788725898.227752:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1089b3b80 x1875614935036544/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788725914 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725898.227771:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6699:1875614935036544:0@lo:5: 00000004:00080000:0.0:1788725898.227785:0:6699:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788725898.261430:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788725899.156107:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788725899.287422:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725900.315822:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725901.336020:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725902.357574:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725902.555613:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788725902.560470:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935036800:0@lo:400: 00000100:00100000:2.0:1788725902.560541:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725902.560599:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788725902.560605:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935036928:0@lo:400: 00000100:00100000:2.0:1788725902.560631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725902.560671:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935036800 00000100:00100000:2.0:1788725902.560678:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935036800 00000100:00100000:2.0:1788725902.560725:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788725902.560736:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935036800:12345-0@lo:400: 00000100:00100000:2.0:1788725902.560792:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935036800:12345-0@lo:400: Request processed in 58us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725902.560799:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788725902.560838:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1089b0a80 x1875614935036800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725902.560851:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935036800:0@lo:400: 00000100:00100000:2.0:1788725902.569092:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935036928 00000100:00100000:2.0:1788725902.569197:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935036928 00000100:00100000:2.0:1788725902.569285:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788725902.569295:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935036928:12345-0@lo:400: 00000100:00100000:2.0:1788725902.569400:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935036928:12345-0@lo:400: Request processed in 106us (8766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725902.569408:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788725902.569429:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788725902.569461:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1089b3800 x1875614935036928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725902.569474:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788725902.569506:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935036928:0@lo:400: 00000100:00100000:3.0:1788725902.571325:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935037056:0@lo:400: 00000100:00100000:3.0:1788725902.571389:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725902.571437:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935036672:0@lo:400: 00000100:00100000:3.0:1788725902.571466:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725902.571712:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935037056 00000100:00100000:2.0:1788725902.571720:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935037056 00000100:00100000:2.0:1788725902.571778:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788725902.571788:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935037056:12345-0@lo:400: 00000100:00100000:2.0:1788725902.571841:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935037056:12345-0@lo:400: Request processed in 54us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725902.571848:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788725902.571922:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788725902.571951:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1089b0380 x1875614935037056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725902.571964:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935037056:0@lo:400: 00000100:00100000:0.0:1788725902.576018:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935036672 00000100:00100000:0.0:1788725902.576621:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935036672 00000100:00100000:0.0:1788725902.576682:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788725902.576692:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:3306:x1875614935036672:12345-0@lo:400: 00000100:00100000:0.0:1788725902.576782:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:3306:x1875614935036672:12345-0@lo:400: Request processed in 91us (5314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725902.576789:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788725902.581769:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935036672:0@lo:400: 00000100:00100000:3.0:1788725903.062770:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725903.062799:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935037184:0@lo:13: 00000100:00100000:3.0:1788725903.062869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725903.063244:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935037184 00000100:00100000:1.0:1788725903.063265:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935037184 00000100:00100000:1.0:1788725903.063308:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788725903.063317:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935037184:12345-0@lo:13: 00002000:00000024:1.0:1788725903.063360:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788725903.063411:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935037184:12345-0@lo:13: Request processed in 94us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725903.063418:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788725903.063501:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1089b2680 x1875614935037184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725903.063520:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935037184:0@lo:13: 00010000:00010000:1.0:1788725903.383646:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725904.405529:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725905.429432:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788725905.947731:0:7615:0:(obd_mount.c:934:lmd_print()) mount data: 00000020:01000004:0.0:1788725905.947735:0:7615:0:(obd_mount.c:937:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788725905.947880:0:7615:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91a13adc2000 00000020:01000004:0.0:1788725905.947896:0:7615:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788725905.947909:0:7615:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788725905.947923:0:7615:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91a112968000) 00000020:00000080:0.0:1788725905.947939:0:7615:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788725905.963211:0:7615:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788725905.963572:0:7615:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788725905.982349:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788725905.986897:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788725905.986935:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788725905.986996:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788725905.987027:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788725905.987606:0:7615:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788725905.987617:0:7615:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788725905.987630:0:7615:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcbde9110e47c0f71 00000020:01000004:3.0:1788725905.987638:0:7615:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788725905.987661:0:7615:0:(obd_mount.c:414:lustre_start_mgc()) MGC192.168.201.142@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788725905.987670:0:7615:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788725905.987675:0:7615:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788725905.987697:0:7615:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788725905.987702:0:7615:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788725906.004032:0:7615:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788725906.004082:0:7615:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.142@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788725906.004086:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788725906.004088:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788725906.004090:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788725906.004091:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788725906.004092:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788725906.004093:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788725906.004095:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788725906.004096:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788725906.004098:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788725906.004099:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788725906.004101:0:7615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788725906.004105:0:7615:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788725906.004107:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788725906.004253:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788725906.004255:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788725906.004256:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788725906.004257:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788725906.004258:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788725906.004259:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788725906.004260:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788725906.004261:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788725906.004262:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788725906.004263:0:7615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788725906.004298:0:7615:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788725906.004316:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935037312:0@lo:253: 00000100:00100000:3.0:1788725906.004386:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725906.004513:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1088c5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788725906.004605:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935037312 00000100:00100000:0.0:1788725906.004616:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935037312 00000100:00100000:0.0:1788725906.004717:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788725906.004727:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:7615:x1875614935037312:12345-0@lo:253: 20000000:01000000:0.0:1788725906.004760:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788725906.004764:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788725906.004770:0:5829:0:(mgs_llog.c:872:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788725906.004773:0:5829:0:(mgs_llog.c:3865:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788725906.005861:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788725906.006060:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788725906.006075:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788725906.006410:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788725906.006419:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788725906.006450:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788725906.006492:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788725906.006840:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788725906.006866:0:5829:0:(mgs_llog.c:3818:mgs_write_log_osc_to_lov()) add nid 192.168.201.142@tcp 20000000:01000000:0.0:1788725906.006869:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf005 192.168.201.142@tcp (null) (null) (null) 00000040:00080000:0.0:1788725906.006899:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788725906.006906:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788725906.006943:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788725906.006950:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.142@tcp (null) (null) 00000040:00080000:0.0:1788725906.006976:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788725906.006983:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788725906.007006:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788725906.007045:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788725906.008005:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788725906.008022:0:5829:0:(mgs_llog.c:3818:mgs_write_log_osc_to_lov()) add nid 192.168.201.142@tcp 20000000:01000000:0.0:1788725906.008024:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf005 192.168.201.142@tcp (null) (null) (null) 00000040:00080000:0.0:1788725906.008054:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788725906.008060:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788725906.008087:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788725906.008093:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.142@tcp (null) (null) 00000040:00080000:0.0:1788725906.008269:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788725906.008278:0:5829:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788725906.008332:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788725906.008363:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788725906.008378:0:5829:0:(mgs_llog.c:5255:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788725906.008380:0:5829:0:(mgs_llog.c:4751:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788725906.008386:0:5829:0:(mgs_llog.c:5255:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788725906.008387:0:5829:0:(mgs_llog.c:4751:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788725906.008389:0:5829:0:(mgs_llog.c:4184:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788725906.008401:0:5829:0:(mgs_llog.c:153:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788725906.008403:0:5829:0:(mgs_llog.c:153:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788725906.008435:0:5829:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788725906.008437:0:5829:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788725906.008932:0:7617:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788725906.008983:0:7617:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788725906.009037:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788725906.009503:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788725906.009542:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788725906.009598:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788725906.009610:0:5829:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788725906.009612:0:5829:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788725906.009958:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788725906.010416:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788725906.010451:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788725906.010530:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788725906.010543:0:5829:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788725906.010544:0:5829:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788725906.011196:0:7619:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788725906.011347:0:7619:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788725906.011383:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788725906.011635:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788725906.011678:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788725906.011732:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788725906.011744:0:5829:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788725906.011746:0:5829:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788725906.012305:0:7620:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788725906.012354:0:7620:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788725906.012409:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788725906.012664:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788725906.012706:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788725906.012742:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:0.0:1788725906.012759:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788725906.012778:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.012802:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0ebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0eb4 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.012810:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0ec2 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.012816:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a100030400/0xcbde9110e47c0eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0ee5 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.012823:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10e725000/0xcbde9110e47c0f08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0f01 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.012829:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10149aa00/0xcbde9110e47c0f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0f2b expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.012835:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f78 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.012884:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10149aa00/0xcbde9110e47c0f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0f2b expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.012900:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a10149aa00/0xcbde9110e47c0f32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0f2b expref: 16 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725906.012914:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935037440:0@lo:104: 00000100:00100000:0.0:1788725906.012980:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788725906.013079:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10e725000/0xcbde9110e47c0f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0f01 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.013087:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a10e725000/0xcbde9110e47c0f08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0f01 expref: 16 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725906.013102:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935037568:0@lo:104: 00000100:00100000:0.0:1788725906.013143:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788725906.013500:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a100030400/0xcbde9110e47c0eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0ee5 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.013509:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a100030400/0xcbde9110e47c0eec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0ee5 expref: 16 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725906.013517:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935037696:0@lo:104: 00000100:00100000:0.0:1788725906.013539:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725906.013556:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935037440 00000100:00100000:3.0:1788725906.013563:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935037440 00000100:00100000:1.0:1788725906.013608:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935037568 00000100:00100000:1.0:1788725906.013611:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935037568 00000100:00100000:1.0:1788725906.013633:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788725906.013642:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+4:5829:x1875614935037440:12345-0@lo:104: 00010000:00010000:1.0:1788725906.013655:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0f32 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725906.013709:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788725906.013716:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+4:5829:x1875614935037440:12345-0@lo:104: Request processed in 75us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725906.013722:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788725906.013737:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788725906.013743:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5829:x1875614935037568:12345-0@lo:104: 00010000:00010000:1.0:1788725906.013750:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c0f01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0f08 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725906.013781:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788725906.013786:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5829:x1875614935037568:12345-0@lo:104: Request processed in 44us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725906.013791:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788725906.013860:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788725906.013866:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0f32 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.013873:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149b200 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:2.0:1788725906.013877:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0f32 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.013885:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0f32 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725906.013899:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0f32 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725906.013905:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725906.013940:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0f32 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.013947:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725906.013964:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0f32 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.013970:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0f32 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.013982:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788725906.013985:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c0f01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0f08 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.013990:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10db71e00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:2.0:1788725906.013993:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c0f01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0f08 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.014000:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c0f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0f08 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725906.014006:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c0f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0f08 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725906.014011:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725906.014031:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c0f01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0f08 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.014037:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725906.014042:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c0f01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0f08 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.014048:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c0f01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0f08 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.014058:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725906.014068:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725906.014070:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725906.014076:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725906.014088:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935037824:0@lo:103: 00000100:00100000:2.0:1788725906.014130:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725906.014154:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788725906.014160:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935037952:0@lo:103: 00000100:00100000:2.0:1788725906.014180:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725906.014232:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935037824 00000100:00100000:2.0:1788725906.014237:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935037824 00010000:00010000:2.0:1788725906.014257:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10149aa00/0xcbde9110e47c0f32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0f2b expref: 17 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725906.014276:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935037952 00000100:00100000:2.0:1788725906.014279:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935037952 00010000:00010000:2.0:1788725906.014289:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10e725000/0xcbde9110e47c0f08 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0f01 expref: 18 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725906.014302:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788725906.014308:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1202a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:3304:x1875614935037824:12345-0@lo:103: 00010000:00010000:2.0:1788725906.014324:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725906.014330:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10149aa00/0xcbde9110e47c0f32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0f2b expref: 18 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.014340:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10149aa00/0xcbde9110e47c0f32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0f2b expref: 18 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.014355:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725906.014382:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1202a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:3304:x1875614935037824:12345-0@lo:103: Request processed in 74us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725906.014388:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788725906.014429:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788725906.014435:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:3304:x1875614935037952:12345-0@lo:103: 00010000:00010000:2.0:1788725906.014442:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725906.014447:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10e725000/0xcbde9110e47c0f08 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0f01 expref: 17 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.014455:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10e725000/0xcbde9110e47c0f08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0f01 expref: 17 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.014464:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725906.014484:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:3304:x1875614935037952:12345-0@lo:103: Request processed in 50us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725906.014490:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788725906.014524:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935037952:0@lo:103: 00000100:00100000:2.0:1788725906.014534:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935037824:0@lo:103: 00010000:00010000:0.0:1788725906.014826:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0ec2 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.014837:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0ec9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0ec2 expref: 16 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725906.014846:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935038080:0@lo:104: 00000100:00100000:0.0:1788725906.014880:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788725906.014897:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0ebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0eb4 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.014905:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0ebb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0eb4 expref: 16 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725906.014913:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935038208:0@lo:104: 00000100:00100000:0.0:1788725906.014932:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725906.014942:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a00512b240 going to sleep for 11 seconds 00010000:00010000:0.0:1788725906.014955:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10149aa00/0xcbde9110e47c0f32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0f2b expref: 16 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725906.014973:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935037440:0@lo:104: 00010000:00010000:0.0:1788725906.014985:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e725000/0xcbde9110e47c0f08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0f01 expref: 15 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725906.014992:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935037568:0@lo:104: 00000100:00100000:3.0:1788725906.015073:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935037696 00000100:00100000:3.0:1788725906.015079:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935037696 00000100:00100000:3.0:1788725906.015205:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935038080 00000100:00100000:3.0:1788725906.015210:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935038080 00000100:00100000:3.0:1788725906.015250:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935038208 00000100:00100000:3.0:1788725906.015253:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935038208 00000100:00100000:3.0:1788725906.015266:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788725906.015272:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+5:5829:x1875614935037696:12345-0@lo:104: 00010000:00010000:3.0:1788725906.015281:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.015327:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788725906.015333:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+5:5829:x1875614935037696:12345-0@lo:104: Request processed in 61us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725906.015339:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788725906.015351:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788725906.015357:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+4:5829:x1875614935038080:12345-0@lo:104: 00010000:00010000:3.0:1788725906.015365:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c0ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0ec9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.015392:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788725906.015397:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+4:5829:x1875614935038080:12345-0@lo:104: Request processed in 40us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725906.015402:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788725906.015412:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788725906.015418:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5829:x1875614935038208:12345-0@lo:104: 00010000:00010000:3.0:1788725906.015425:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.015449:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788725906.015460:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5829:x1875614935038208:12345-0@lo:104: Request processed in 42us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725906.015466:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788725906.015589:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788725906.015595:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.015606:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031e00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:2.0:1788725906.015609:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.015616:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725906.015622:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725906.015628:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725906.015661:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.015668:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725906.015692:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.015699:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c0ee5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.015711:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788725906.015713:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c0ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0ec9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.015718:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030e00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:2.0:1788725906.015720:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c0ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0ec9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.015735:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c0ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0ec9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725906.015742:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c0ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0ec9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725906.015747:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725906.015759:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c0ec2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0ec9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.015765:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725906.015770:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c0ec2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0ec9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.015776:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c0ec2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0ec9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.015786:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788725906.015789:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.015794:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031600 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:2.0:1788725906.015797:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.015803:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725906.015809:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725906.015819:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725906.015830:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.015835:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725906.015845:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.015863:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c0eb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0ebb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.015876:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725906.015878:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725906.015879:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725906.015889:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935038464:0@lo:103: 00000100:00100000:2.0:1788725906.015917:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725906.015942:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725906.015947:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935038336:0@lo:103: 00000100:00100000:2.0:1788725906.015962:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725906.015979:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725906.015985:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935038592:0@lo:103: 00000100:00100000:2.0:1788725906.016003:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725906.016022:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935038464 00000100:00100000:2.0:1788725906.016026:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935038464 00010000:00010000:2.0:1788725906.016045:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0ec9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0ec2 expref: 15 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.016303:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725906.016328:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935037696:0@lo:104: 00000100:00100000:0.0:1788725906.016336:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935038080:0@lo:104: 00000100:00100000:0.0:1788725906.016342:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1875614935038208:0@lo:104: 00010000:00010000:0.0:1788725906.016363:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725906.016410:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935038336 00000100:00100000:2.0:1788725906.016420:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935038336 00010000:00010000:2.0:1788725906.016435:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a100030400/0xcbde9110e47c0eec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0ee5 expref: 16 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725906.016448:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935038592 00000100:00100000:2.0:1788725906.016451:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935038592 00010000:00010000:2.0:1788725906.016476:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0ebb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0eb4 expref: 17 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725906.016491:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788725906.016497:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:3307:x1875614935038464:12345-0@lo:103: 00010000:00010000:2.0:1788725906.016508:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725906.016512:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0ec9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0ec2 expref: 17 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016521:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0ec2 expref: 17 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016533:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100031a00/0xcbde9110e47c0ec9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0ec2 expref: 17 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016544:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725906.016619:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:3307:x1875614935038464:12345-0@lo:103: Request processed in 122us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725906.016626:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788725906.016641:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788725906.016647:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:3307:x1875614935038336:12345-0@lo:103: 00010000:00010000:2.0:1788725906.016654:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725906.016658:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a100030400/0xcbde9110e47c0eec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0ee5 expref: 15 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016677:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a100030400/0xcbde9110e47c0eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0ee5 expref: 15 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016687:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100030400/0xcbde9110e47c0eec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0ee5 expref: 15 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016695:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725906.016717:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:3307:x1875614935038336:12345-0@lo:103: Request processed in 71us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725906.016722:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788725906.016734:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788725906.016740:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:3305:x1875614935038592:12345-0@lo:103: 00010000:00010000:2.0:1788725906.016749:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725906.016753:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0ebb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0eb4 expref: 13 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016761:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0ebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0eb4 expref: 13 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016771:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0ebb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0eb4 expref: 13 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016782:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f78 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016790:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f78 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016803:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016815:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016821:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f78 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016827:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016832:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031000 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788725906.016836:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016842:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f78 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016870:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f78 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.016880:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725906.016908:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:3305:x1875614935038592:12345-0@lo:103: Request processed in 168us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725906.016914:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788725906.016943:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935038592:0@lo:103: 00010000:00010000:0.0:1788725906.017056:0:5829:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.017073:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.017079:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f78 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788725906.017092:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788725906.017843:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935038464:0@lo:103: 00000100:00100000:2.0:1788725906.019328:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935038336:0@lo:103: 00000100:00100000:3.0:1788725906.076436:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:7615:x1875614935037312:12345-0@lo:253: Request processed in 71701us (72040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725906.076452:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788725906.076556:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935037312:0@lo:253: 10000000:01000000:2.0:1788725906.076575:0:7615:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788725906.076594:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788725906.076596:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788725906.076597:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788725906.076599:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788725906.076600:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788725906.076601:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788725906.076603:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788725906.076605:0:7615:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788725906.076607:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788725906.076608:0:7615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788725906.076628:0:7615:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91a13adc2000 from lustre-OST0001 10000000:01000000:2.0:1788725906.076665:0:7615:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788725906.076668:0:7615:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788725906.076676:0:7615:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91a103273370 local copy 10000000:01000000:2.0:1788725906.076680:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788725906.076719:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724200/0xcbde9110e47c0f7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.076732:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.142@tcp lock: ffff91a10e724200/0xcbde9110e47c0f7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.076742:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e724200/0xcbde9110e47c0f7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725906.076760:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935038720:0@lo:101: 00000100:00100000:2.0:1788725906.076800:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725906.076868:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1117483c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725906.076894:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935038720 00000100:00100000:2.0:1788725906.076900:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935038720 00000100:00100000:2.0:1788725906.076935:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788725906.076942:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:7615:x1875614935038720:12345-0@lo:101: 00010000:00010000:2.0:1788725906.076954:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725906.076965:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c0f86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0f7f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.076993:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c0f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0f7f expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.077003:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c0f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0f7f expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.077012:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725e00, rc 0) 00000100:00100000:2.0:1788725906.077046:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:7615:x1875614935038720:12345-0@lo:101: Request processed in 104us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725906.077052:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788725906.077490:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935038720:0@lo:101: 00010000:00010000:1.0:1788725906.077505:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e724200/0xcbde9110e47c0f7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcbde9110e47c0f86 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725906.077514:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e724200/0xcbde9110e47c0f7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcbde9110e47c0f86 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725906.077608:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139866d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935038848:0@lo:501: 00000100:00100000:1.0:1788725906.077637:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725906.077667:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a108762600 going to sleep for 11 seconds 00000100:00100000:0.0:1788725906.077719:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935038848 00000100:00100000:0.0:1788725906.077725:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935038848 00000100:00100000:0.0:1788725906.077758:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788725906.077765:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:7615:x1875614935038848:12345-0@lo:501: 00000100:00100000:0.0:1788725906.077992:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:7615:x1875614935038848:12345-0@lo:501: Request processed in 227us (353us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788725906.078007:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788725906.078369:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139866d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935038848:0@lo:501: 10000000:01000000:1.0:1788725906.078386:0:7615:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788725906.078414:0:7615:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788725906.078420:0:7615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724200/0xcbde9110e47c0f7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcbde9110e47c0f86 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725906.078428:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724200/0xcbde9110e47c0f7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcbde9110e47c0f86 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725906.078435:0:7615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff91a10e724200/0xcbde9110e47c0f7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcbde9110e47c0f86 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725906.078457:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788725906.078477:0:7615:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91a13adc2000 10000000:01000000:1.0:1788725906.078481:0:7615:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788725906.078485:0:7615:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788725906.078488:0:7615:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788725906.078492:0:7615:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788725906.078499:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788725906.078518:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725906.078526:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725906.078536:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725906.078549:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139866d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935038976:0@lo:101: 00000100:00100000:1.0:1788725906.078579:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725906.078600:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a108762cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788725906.078656:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725906.078662:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e724200/0xcbde9110e47c0f7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcbde9110e47c0f86 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.078670:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724200 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:3.0:1788725906.078674:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724200/0xcbde9110e47c0f7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcbde9110e47c0f86 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.078682:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e724200/0xcbde9110e47c0f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcbde9110e47c0f86 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725906.078690:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724200/0xcbde9110e47c0f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcbde9110e47c0f86 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725906.078696:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725906.078715:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e724200/0xcbde9110e47c0f7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcbde9110e47c0f86 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.078721:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725906.078743:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e724200/0xcbde9110e47c0f7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcbde9110e47c0f86 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.078751:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e724200/0xcbde9110e47c0f7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcbde9110e47c0f86 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.078772:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725906.078774:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725906.078776:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725906.078911:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788725906.078924:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935039104:0@lo:103: 00000100:00100000:2.0:1788725906.078957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725906.079080:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935039104 00000100:00100000:3.0:1788725906.079087:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935039104 00000100:00100000:3.0:1788725906.079199:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788725906.079207:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:3304:x1875614935039104:12345-0@lo:103: 00010000:00010000:3.0:1788725906.079256:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725906.079271:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c0f86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbde9110e47c0f7f expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.079285:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725906.079392:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:3304:x1875614935039104:12345-0@lo:103: Request processed in 185us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725906.079400:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788725906.079471:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935038976 00000100:00100000:0.0:1788725906.079476:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935038976 00000100:00100000:0.0:1788725906.079509:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788725906.079516:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+11:7615:x1875614935038976:12345-0@lo:101: 00010000:00010000:0.0:1788725906.079526:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725906.079538:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0f8d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.079556:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0f8d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.079567:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0f8d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.079573:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100031000, rc 0) 00000100:00100000:0.0:1788725906.079602:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:7615:x1875614935038976:12345-0@lo:101: Request processed in 87us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725906.079607:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788725906.079749:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139866d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935038976:0@lo:101: 00010000:00010000:1.0:1788725906.079762:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0f94 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725906.079771:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0f94 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725906.080027:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139866d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935039232:0@lo:501: 00000100:00100000:1.0:1788725906.080066:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725906.080098:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a108762cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725906.080372:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935039232 00000100:00100000:0.0:1788725906.080378:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935039232 00000100:00100000:0.0:1788725906.080405:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788725906.080412:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:7615:x1875614935039232:12345-0@lo:501: 00000100:00100000:0.0:1788725906.080633:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:7615:x1875614935039232:12345-0@lo:501: Request processed in 221us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725906.080641:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788725906.080740:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139866d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935039232:0@lo:501: 00000100:00100000:1.0:1788725906.080768:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139866d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935039360:0@lo:503: 00000100:00100000:1.0:1788725906.080805:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725906.080822:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a108762cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725906.081000:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935039360 00000100:00100000:3.0:1788725906.081005:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935039360 00000100:00100000:3.0:1788725906.081027:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788725906.081034:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:7615:x1875614935039360:12345-0@lo:503: 00000100:00100000:3.0:1788725906.081288:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:7615:x1875614935039360:12345-0@lo:503: Request processed in 253us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725906.081371:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788725906.081468:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935039104:0@lo:103: 00000100:00100000:1.0:1788725906.081592:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139866d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935039360:0@lo:503: 00000040:00080000:1.0:1788725906.082030:0:7615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788725906.082246:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139866d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935039488:0@lo:502: 00000100:00100000:1.0:1788725906.082405:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725906.082468:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a108762cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725906.082992:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935039488 00000100:00100000:3.0:1788725906.082999:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935039488 00000100:00100000:3.0:1788725906.083098:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788725906.083265:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:7615:x1875614935039488:12345-0@lo:502: 00000100:00100000:3.0:1788725906.083634:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:7615:x1875614935039488:12345-0@lo:502: Request processed in 527us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725906.083648:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788725906.083743:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139866d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935039488:0@lo:502: 00000040:00080000:1.0:1788725906.084046:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788725906.084126:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788725906.084162:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788725906.084206:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788725906.084263:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788725906.084309:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788725906.084341:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139866d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935039616:0@lo:502: 00000100:00100000:1.0:1788725906.084384:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725906.085874:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a108762cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725906.086263:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935039616 00000100:00100000:0.0:1788725906.086274:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935039616 00000100:00100000:0.0:1788725906.086356:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788725906.086366:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:7615:x1875614935039616:12345-0@lo:502: 00000100:00100000:0.0:1788725906.086623:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:7615:x1875614935039616:12345-0@lo:502: Request processed in 258us (2238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725906.086632:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788725906.086813:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139866d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935039616:0@lo:502: 00000040:00080000:1.0:1788725906.086981:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788725906.086997:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788725906.087974:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788725906.087983:0:7622:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788725906.087990:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725906.087992:0:7622:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788725906.087997:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788725906.088012:0:7622:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff91a1111d3370) 00000020:00000080:1.0:1788725906.088035:0:7622:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788725906.088041:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788725906.088405:0:7622:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a13adc2000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788725906.088413:0:7622:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788725906.088420:0:7622:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcbde9110e47c0fa2 00010000:00010000:1.0:1788725906.094473:0:7622:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788725906.094791:0:7622:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788725906.098685:0:7622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788725906.099174:0:7622:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788725906.105020:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788725906.105758:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788725906.107547:0:7622:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788725906.107559:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725906.107565:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725906.107567:0:7622:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788725906.107571:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788725906.107575:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725906.107576:0:7622:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788725906.107579:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788725906.107581:0:7622:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788725906.107634:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725906.107638:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725906.107639:0:7622:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788725906.107642:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788725906.107878:0:7615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788725906.107906:0:7615:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788725906.107929:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0f94 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.107943:0:7615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0f94 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725906.107952:0:7615:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a13adc2000 from 1 10000000:01000000:3.0:1788725906.107955:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788725906.107997:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71a00/0xcbde9110e47c0fa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.108006:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10db71a00/0xcbde9110e47c0fa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.108019:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10db71a00/0xcbde9110e47c0fa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725906.108044:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935039744:0@lo:101: 00000100:00100000:3.0:1788725906.108613:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725906.108659:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1088c59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725906.111009:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935039744 00000100:00100000:0.0:1788725906.111024:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935039744 00000100:00100000:0.0:1788725906.111096:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788725906.111115:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:7615:x1875614935039744:12345-0@lo:101: 00010000:00010000:0.0:1788725906.111135:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725906.111154:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a100030200/0xcbde9110e47c0fb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0fa9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.111181:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a100030200/0xcbde9110e47c0fb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0fa9 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.111192:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a100030200/0xcbde9110e47c0fb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0fa9 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.111203:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100030200, rc 0) 00000100:00100000:0.0:1788725906.111281:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:7615:x1875614935039744:12345-0@lo:101: Request processed in 176us (2668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725906.111288:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788725906.113509:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935039744:0@lo:101: 00010000:00010000:3.0:1788725906.113539:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10db71a00/0xcbde9110e47c0fa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0fb0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.113552:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10db71a00/0xcbde9110e47c0fa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0fb0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725906.113702:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935039872:0@lo:501: 00000100:00100000:3.0:1788725906.113764:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725906.113805:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1088c59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725906.114300:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935039872 00000100:00100000:2.0:1788725906.114308:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935039872 00000100:00100000:2.0:1788725906.114356:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788725906.114367:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:7615:x1875614935039872:12345-0@lo:501: 00000100:00100000:2.0:1788725906.114644:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:7615:x1875614935039872:12345-0@lo:501: Request processed in 277us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725906.114652:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788725906.114985:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935039872:0@lo:501: 00000100:00100000:3.0:1788725906.115016:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040000:0@lo:503: 00000100:00100000:3.0:1788725906.115056:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725906.115093:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1088c59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725906.116261:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935040000 00000100:00100000:2.0:1788725906.116271:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935040000 00000100:00100000:2.0:1788725906.116970:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788725906.116989:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:7615:x1875614935040000:12345-0@lo:503: 00000100:00100000:2.0:1788725906.117562:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:7615:x1875614935040000:12345-0@lo:503: Request processed in 576us (2504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725906.117576:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788725906.117641:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040000:0@lo:503: 00000040:00080000:2.0:1788725906.117978:0:7615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788725906.118071:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040128:0@lo:502: 00000100:00100000:2.0:1788725906.119423:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725906.119466:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748600 going to sleep for 11 seconds 00000100:00100000:3.0:1788725906.119891:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935040128 00000100:00100000:3.0:1788725906.119900:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935040128 00000100:00100000:3.0:1788725906.119954:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788725906.119963:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:7615:x1875614935040128:12345-0@lo:502: 00000100:00100000:3.0:1788725906.120571:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:7615:x1875614935040128:12345-0@lo:502: Request processed in 607us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725906.120580:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788725906.120700:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040128:0@lo:502: 00000040:00080000:2.0:1788725906.122421:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788725906.122489:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788725906.122530:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040256:0@lo:502: 00000100:00100000:2.0:1788725906.122588:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725906.122629:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748600 going to sleep for 11 seconds 00000100:00100000:0.0:1788725906.122754:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935040256 00000100:00100000:0.0:1788725906.122762:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935040256 00000100:00100000:0.0:1788725906.122807:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788725906.122815:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:7615:x1875614935040256:12345-0@lo:502: 00000100:00100000:0.0:1788725906.122991:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:7615:x1875614935040256:12345-0@lo:502: Request processed in 176us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725906.123002:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788725906.123703:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040256:0@lo:502: 00000040:00080000:3.0:1788725906.123823:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788725906.123834:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788725906.124721:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725906.124732:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725906.124734:0:7626:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788725906.124740:0:7626:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a13adc2000 00000020:00000080:3.0:1788725906.124742:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788725906.124762:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788725906.124765:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725906.124767:0:7626:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788725906.124770:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788725906.124901:0:7615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788725906.124922:0:7615:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788725906.124967:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71a00/0xcbde9110e47c0fa9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0fb0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.124978:0:7615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10db71a00/0xcbde9110e47c0fa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0fb0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725906.125016:0:7615:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788725906.125018:0:7615:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91a13adc2000 10000000:01000000:2.0:1788725906.125021:0:7615:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91a13adc2000 10000000:01000000:2.0:1788725906.125024:0:7615:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788725906.125029:0:7615:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91a13adc2000 from 1 10000000:01000000:2.0:1788725906.125031:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788725906.125061:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c0fb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.125084:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c0fb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.125096:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c0fb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725906.125130:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040384:0@lo:101: 00000100:00100000:2.0:1788725906.125182:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725906.125263:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788725906.125533:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935040384 00000100:00100000:3.0:1788725906.125540:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935040384 00000100:00100000:3.0:1788725906.125581:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788725906.125590:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:7615:x1875614935040384:12345-0@lo:101: 00010000:00010000:3.0:1788725906.125603:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725906.125616:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0fbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0fb7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.125636:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0fbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0fb7 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.125646:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0fbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0fb7 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.125655:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10db70000, rc 0) 00000100:00100000:3.0:1788725906.125690:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:7615:x1875614935040384:12345-0@lo:101: Request processed in 101us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725906.125695:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788725906.126061:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040384:0@lo:101: 00010000:00010000:2.0:1788725906.126075:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c0fb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0fbe expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725906.126084:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c0fb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0fbe expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725906.126199:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040512:0@lo:501: 00000100:00100000:2.0:1788725906.126414:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725906.126443:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788725906.126585:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935040512 00000100:00100000:3.0:1788725906.126591:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935040512 00000100:00100000:3.0:1788725906.126625:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788725906.126632:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:7615:x1875614935040512:12345-0@lo:501: 00000100:00100000:3.0:1788725906.126843:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:7615:x1875614935040512:12345-0@lo:501: Request processed in 211us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725906.126862:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788725906.126961:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040512:0@lo:501: 00000100:00100000:2.0:1788725906.126991:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040640:0@lo:503: 00000100:00100000:2.0:1788725906.127029:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725906.127065:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788725906.127119:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935040640 00000100:00100000:0.0:1788725906.127124:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935040640 00000100:00100000:0.0:1788725906.127154:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788725906.127161:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:7615:x1875614935040640:12345-0@lo:503: 00000100:00100000:0.0:1788725906.127336:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:7615:x1875614935040640:12345-0@lo:503: Request processed in 175us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725906.127342:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788725906.127620:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040640:0@lo:503: 00000040:00080000:2.0:1788725906.127898:0:7615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788725906.127958:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040768:0@lo:502: 00000100:00100000:2.0:1788725906.127995:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725906.128028:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788725906.128173:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935040768 00000100:00100000:0.0:1788725906.128179:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935040768 00000100:00100000:2.0:1788725906.128287:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788725906.128368:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:7615:x1875614935040768:12345-0@lo:502: 00000100:00100000:2.0:1788725906.128635:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:7615:x1875614935040768:12345-0@lo:502: Request processed in 269us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725906.128641:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788725906.128826:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040768:0@lo:502: 00000040:00080000:2.0:1788725906.129893:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788725906.129979:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788725906.130017:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788725906.130199:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788725906.130483:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788725906.130541:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788725906.130579:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788725906.130615:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788725906.130664:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788725906.130701:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788725906.130737:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788725906.130787:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788725906.130841:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788725906.130893:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788725906.130945:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788725906.130982:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788725906.131017:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788725906.131091:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788725906.131247:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788725906.131288:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788725906.131427:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788725906.131465:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788725906.131501:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788725906.131582:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788725906.131621:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788725906.131657:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788725906.131707:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788725906.131744:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788725906.131798:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788725906.131873:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788725906.131913:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788725906.131946:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788725906.131974:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788725906.132014:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788725906.132049:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788725906.132096:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788725906.132554:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788725906.132604:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040896:0@lo:502: 00000100:00100000:2.0:1788725906.132686:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725906.132771:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788725906.132936:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935040896 00000100:00100000:3.0:1788725906.132944:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935040896 00000100:00100000:2.0:1788725906.133155:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788725906.133166:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:7615:x1875614935040896:12345-0@lo:502: 00000100:00100000:2.0:1788725906.133600:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:7615:x1875614935040896:12345-0@lo:502: Request processed in 435us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725906.133609:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788725906.133752:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935040896:0@lo:502: 00000040:00080000:3.0:1788725906.133845:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788725906.133867:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788725906.134890:0:7627:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788725906.134907:0:7627:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91a110b4b370) 00000020:00000080:3.0:1788725906.134930:0:7627:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788725906.135017:0:7627:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a13adc2000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788725906.135022:0:7627:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a13adc2000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788725906.135024:0:7627:0:(obd_mount.c:721:lustre_put_lsi()) put ffff91a13adc2000 3 00010000:00080000:3.0:1788725906.135056:0:7627:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a006f05000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788725906.138476:0:7627:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788725906.138794:0:7627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788725906.138857:0:7627:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788725906.138870:0:7627:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcbde9110e47c0fcc 00000100:00080000:3.0:1788725906.138881:0:7627:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788725906.138887:0:7627:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91a006f05000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788725906.138923:0:7627:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a1111d9880 x1875614935041024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788725906.138982:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875614935041024:0@lo:38: 00000100:00100000:1.0:1788725906.139056:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788725906.139143:0:7627:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788725906.139438:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935041024 00000100:00100000:2.0:1788725906.139446:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935041024 00000100:00100000:2.0:1788725906.139478:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788725906.139486:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875614935041024:12345-0@lo:38: 00010000:00080000:2.0:1788725906.139511:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:2.0:1788725906.139541:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcbde9110e47c0fd3 00000004:00100000:2.0:1788725906.139556:0:5834:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788725906.139600:0:5834:0:(import.c:65:import_set_state_nolock()) ffff91a13f440000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788725906.140373:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935041152:0@lo:400: 00000100:00100000:3.0:1788725906.140415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725906.140444:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725906.140450:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935041280:0@lo:400: 00000100:00100000:3.0:1788725906.140472:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725906.140493:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788725906.140499:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935041408:0@lo:400: 00000100:00100000:3.0:1788725906.140518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725906.140538:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935041280 00000100:00100000:3.0:1788725906.140550:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935041280 00000100:00100000:3.0:1788725906.140589:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788725906.140597:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935041280:12345-0@lo:400: 00000100:00100000:3.0:1788725906.140633:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935041280:12345-0@lo:400: Request processed in 37us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725906.140639:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788725906.140654:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725906.140663:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788725906.140669:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:3.0:1788725906.140694:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1111daa00 x1875614935041280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725906.140708:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935041280:0@lo:400: 00000100:00100000:3.0:1788725906.140813:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935041152 00000100:00100000:3.0:1788725906.140816:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935041152 00000100:00100000:3.0:1788725906.140833:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788725906.140837:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935041408 00000100:00100000:3.0:1788725906.140838:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935041408 00000100:00100000:3.0:1788725906.140864:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788725906.140873:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788725906.140879:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935041152:12345-0@lo:400: 00000100:00100000:3.0:1788725906.140910:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935041152:12345-0@lo:400: Request processed in 31us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725906.140915:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788725906.140923:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788725906.140928:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788725906.140933:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935041408:12345-0@lo:400: 00000100:00100000:3.0:1788725906.140954:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935041408:12345-0@lo:400: Request processed in 21us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725906.140967:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788725906.140979:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788725906.140993:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1111d8e00 x1875614935041152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725906.141003:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935041152:0@lo:400: 00010000:00080000:3.0:1788725906.141020:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1111d9c00 x1875614935041408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725906.141029:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935041408:0@lo:400: 00000100:00100000:2.0:1788725906.143281:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875614935041024:12345-0@lo:38: Request processed in 3784us (4215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725906.143303:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:0.0:1788725906.143949:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1788725906.146193:0:7628:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff91a1089b0a80 x1875614935041536/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725906.146222:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a103348b40 going to sleep for 0 seconds 00000020:01000000:3.0:1788725906.147284:0:7615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788725906.147336:0:7615:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788725906.147355:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c0fb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0fbe expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.147366:0:7615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c0fb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0fbe expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788725906.147415:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788725906.147417:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788725906.147419:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788725906.147420:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788725906.147421:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788725906.147422:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788725906.147424:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788725906.147426:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788725906.147427:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788725906.147428:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788725906.147430:0:7615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788725906.147433:0:7615:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788725906.147436:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788725906.147437:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788725906.147441:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788725906.147442:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788725906.147443:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788725906.147444:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788725906.147445:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788725906.147446:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788725906.147447:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788725906.147448:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788725906.147449:0:7615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788725906.147476:0:7615:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788725906.147491:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935041664:0@lo:253: 00000100:00100000:3.0:1788725906.147569:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725906.147608:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1088c5a80 going to sleep for 11 seconds 00010000:00080000:1.0:1788725906.147815:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1111d9880 x1875614935041024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788725916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725906.147827:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788725906.147835:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788725906.147841:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788725906.147857:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788725906.147862:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a006f05000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788725906.147871:0:3303:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000083396355): req@ffff91a1089b0a80 x1875614935041536/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725906.147982:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935041664 00000100:00100000:2.0:1788725906.147998:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935041664 00000100:00100000:2.0:1788725906.148067:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788725906.148082:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:7615:x1875614935041664:12345-0@lo:253: 20000000:01000000:2.0:1788725906.148135:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788725906.148154:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788725906.150856:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875614935041024:0@lo:38: 00000100:00100000:1.0:1788725906.151342:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725906.151373:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a103348b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788725906.154908:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935041536 00000100:00100000:3.0:1788725906.154926:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935041536 00000100:00080000:0.0:1788725906.156233:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725906.156596:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788725906.156609:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7628:x1875614935041536:12345-0@lo:901: 00000100:00100000:3.0:1788725906.157031:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7628:x1875614935041536:12345-0@lo:901: Request processed in 425us (5688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725906.157040:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788725906.157590:0:7628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a1089b0a80 x1875614935041536/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788725922 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725906.157606:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7628:1875614935041536:0@lo:901: 20000000:01000000:3.0:1788725906.179937:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788725906.179958:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788725906.180010:0:5850:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788725906.180016:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788725906.180039:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0fda lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.180066:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a100031800/0xcbde9110e47c0f63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0f5c expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.180075:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0fda lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.180185:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a100031800/0xcbde9110e47c0f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0f5c expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.180201:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a100031800/0xcbde9110e47c0f63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0f5c expref: 14 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725906.180252:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1875614935041792:0@lo:104: 00000100:00100000:0.0:1788725906.180389:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725906.180440:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725906.181241:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935041792 00000100:00100000:3.0:1788725906.181251:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935041792 00000100:00100000:3.0:1788725906.181374:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788725906.181385:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5850:x1875614935041792:12345-0@lo:104: 00010000:00010000:3.0:1788725906.181402:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c0f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0f63 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725906.181486:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788725906.181493:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:5850:x1875614935041792:12345-0@lo:104: Request processed in 110us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725906.181500:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788725906.181881:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788725906.181888:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c0f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0f63 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.181897:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724600 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788725906.181901:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c0f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0f63 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.181911:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c0f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0f63 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725906.181919:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c0f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0f63 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725906.181925:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788725906.181959:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c0f5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0f63 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.181965:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725906.181992:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c0f5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0f63 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.181999:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c0f5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0f63 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.182014:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725906.182021:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725906.182023:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725906.182035:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725906.182047:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935041920:0@lo:103: 00000100:00100000:0.0:1788725906.182097:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725906.182616:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1875614935041792:0@lo:104: 00010000:00010000:1.0:1788725906.182637:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0fda lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725906.183052:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935041920 00000100:00100000:0.0:1788725906.183070:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935041920 00010000:00010000:0.0:1788725906.183097:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a100031800/0xcbde9110e47c0f63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0f5c expref: 15 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725906.183137:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788725906.183144:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:3304:x1875614935041920:12345-0@lo:103: 00010000:00010000:0.0:1788725906.183156:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725906.183163:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a100031800/0xcbde9110e47c0f63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0f5c expref: 15 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.183173:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a100031800/0xcbde9110e47c0f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0f5c expref: 15 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.183188:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100031800/0xcbde9110e47c0f63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0f5c expref: 15 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.183202:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0fda lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.183209:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0fda lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788725906.183242:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003227527s 00010000:00010000:0.0:1788725906.183247:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0fda lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.183268:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0fda lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.183274:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0fda lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.183281:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0fda lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.183287:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031c00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:0.0:1788725906.183369:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0fda lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.183378:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0fda lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.183394:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0fda lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.183403:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725906.183444:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:3304:x1875614935041920:12345-0@lo:103: Request processed in 299us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725906.183451:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788725906.183483:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935041920:0@lo:103: 00010000:00010000:0.0:1788725906.183501:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0fda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.183508:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0fda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725906.183524:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100031c00/0xcbde9110e47c0fda lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725906.190015:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:7615:x1875614935041664:12345-0@lo:253: Request processed in 41915us (42424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725906.190034:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788725906.190655:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7615:1875614935041664:0@lo:253: 10000000:01000000:3.0:1788725906.190671:0:7615:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788725906.190674:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788725906.190676:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788725906.190678:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788725906.190679:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788725906.190681:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788725906.190682:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788725906.190683:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788725906.190685:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788725906.190686:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788725906.190688:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788725906.190690:0:7615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788725906.190703:0:7615:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788725906.196197:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788725906.196569:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788725906.196775:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788725906.196967:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788725906.197403:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788725906.197680:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788725906.199663:0:7615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788725906.407445:0:7615:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788725906.407454:0:7615:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788725906.407491:0:7615:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788725906.407551:0:7615:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788725906.407565:0:7615:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788725906.407594:0:7615:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788725906.453302:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725907.480972:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725908.183483:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935042048:0@lo:13: 00000100:00100000:3.0:1788725908.183566:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725908.185688:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935042048 00000100:00100000:1.0:1788725908.185704:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935042048 00000100:00100000:1.0:1788725908.185771:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788725908.185783:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935042048:12345-0@lo:13: 00002000:00000024:1.0:1788725908.185857:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788725908.185896:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725908.185947:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935042048:12345-0@lo:13: Request processed in 167us (2381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725908.185954:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788725908.186261:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1089b0e00 x1875614935042048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725908.186283:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935042048:0@lo:13: 00010000:00010000:3.0:1788725908.501300:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725909.526604:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725910.551981:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725911.256116:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935042176:0@lo:400: 00000100:00100000:1.0:1788725911.256198:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725911.256272:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788725911.256279:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935042560:0@lo:400: 00000100:00100000:1.0:1788725911.256312:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725911.256346:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935042560 00000100:00100000:1.0:1788725911.256360:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935042560 00000100:00100000:1.0:1788725911.256414:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788725911.256423:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935042560:12345-0@lo:400: 00000100:00100000:1.0:1788725911.256471:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935042560:12345-0@lo:400: Request processed in 49us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725911.256477:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788725911.256514:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1089b0a80 x1875614935042560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725911.256528:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935042560:0@lo:400: 00000100:00100000:1.0:1788725911.256566:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935042432:0@lo:400: 00000100:00100000:1.0:1788725911.256594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725911.256615:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788725911.256621:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935042304:0@lo:400: 00000100:00100000:1.0:1788725911.256640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725911.256669:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935042432 00000100:00100000:1.0:1788725911.256673:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935042432 00000100:00100000:1.0:1788725911.256702:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788725911.256709:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935042432:12345-0@lo:400: 00000100:00100000:1.0:1788725911.256942:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935042432:12345-0@lo:400: Request processed in 53us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725911.256950:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788725911.256969:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935042304 00000100:00100000:1.0:1788725911.256973:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935042304 00000100:00100000:1.0:1788725911.257151:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788725911.257158:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935042304:12345-0@lo:400: 00000100:00100000:1.0:1788725911.257194:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935042304:12345-0@lo:400: Request processed in 36us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725911.257210:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788725911.257267:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1089b0700 x1875614935042304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725911.257278:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935042304:0@lo:400: 00010000:00080000:1.0:1788725911.257288:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1089b3800 x1875614935042432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725911.257296:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935042432:0@lo:400: 00000100:00080000:1.0:1788725911.257428:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788725911.257433:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725911.257452:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935042176 00000100:00100000:1.0:1788725911.257457:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935042176 00000100:00100000:1.0:1788725911.257484:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788725911.257491:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:3307:x1875614935042176:12345-0@lo:400: 00000100:00100000:1.0:1788725911.257528:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:3307:x1875614935042176:12345-0@lo:400: Request processed in 38us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725911.257535:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788725911.257567:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935042176:0@lo:400: 00000100:00100000:0.0:1788725911.257805:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788725911.257817:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935042688:0@lo:400: 00000100:00100000:0.0:1788725911.257854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725911.257881:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935042688 00000100:00100000:0.0:1788725911.257886:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935042688 00000100:00100000:0.0:1788725911.257918:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788725911.257926:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935042688:12345-0@lo:400: 00000100:00100000:0.0:1788725911.257960:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935042688:12345-0@lo:400: Request processed in 35us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725911.257965:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788725911.258157:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788725911.258187:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a141d30700 x1875614935042688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725911.258198:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935042688:0@lo:400: 00010000:00010000:0.0:1788725911.574398:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788725911.770474:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788725911.770481:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91a10338f800 from 30 10000000:01000000:1.0:1788725911.770487:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788725911.770535:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10149ae00/0xcbde9110e47c0fe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725911.770555:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10149ae00/0xcbde9110e47c0fe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725911.770568:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10149ae00/0xcbde9110e47c0fe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725911.770592:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935042816:0@lo:101: 00000100:00100000:1.0:1788725911.770661:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725911.770765:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1068f3480 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.773652:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935042816 00000100:00100000:2.0:1788725911.773667:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935042816 00000100:00100000:2.0:1788725911.773729:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788725911.773739:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:5831:x1875614935042816:12345-0@lo:101: 00010000:00010000:2.0:1788725911.773768:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725911.773786:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e724400/0xcbde9110e47c0fe8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0fe1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.773815:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e724400/0xcbde9110e47c0fe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0fe1 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.773826:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e724400/0xcbde9110e47c0fe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0fe1 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.773849:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724400, rc 0) 00000100:00100000:2.0:1788725911.773920:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:5831:x1875614935042816:12345-0@lo:101: Request processed in 182us (3258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.773927:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788725911.774053:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935042816:0@lo:101: 00010000:00010000:2.0:1788725911.774070:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10149ae00/0xcbde9110e47c0fe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0fe8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.774080:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10149ae00/0xcbde9110e47c0fe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0fe8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725911.774149:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935042944:0@lo:501: 00000100:00100000:2.0:1788725911.774183:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.774242:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a005881780 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.774257:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935042944 00000100:00100000:2.0:1788725911.774261:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935042944 00000100:00100000:2.0:1788725911.774285:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788725911.774292:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:5831:x1875614935042944:12345-0@lo:501: 00000100:00100000:2.0:1788725911.774714:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:5831:x1875614935042944:12345-0@lo:501: Request processed in 421us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.774722:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788725911.774780:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935042944:0@lo:501: 00000100:00100000:2.0:1788725911.774810:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935043072:0@lo:503: 00000100:00100000:2.0:1788725911.774850:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.774865:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a005881780 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.774883:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935043072 00000100:00100000:2.0:1788725911.774887:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935043072 00000100:00100000:2.0:1788725911.774912:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788725911.774919:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:5831:x1875614935043072:12345-0@lo:503: 00000100:00100000:2.0:1788725911.775529:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:5831:x1875614935043072:12345-0@lo:503: Request processed in 608us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.775537:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788725911.775577:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935043072:0@lo:503: 00000100:00100000:2.0:1788725911.778709:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7876:1875614935043200:0@lo:502: 00000100:00100000:2.0:1788725911.778809:0:7876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.778857:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935043200 00000100:00100000:2.0:1788725911.778865:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935043200 00000100:00100000:2.0:1788725911.778910:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788725911.778921:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:7876:x1875614935043200:12345-0@lo:502: 00000100:00100000:2.0:1788725911.779469:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:7876:x1875614935043200:12345-0@lo:502: Request processed in 548us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.779479:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788725911.779538:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a005881780 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.779562:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7876:1875614935043200:0@lo:502: 00000100:00100000:2.0:1788725911.779614:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7876:1875614935043328:0@lo:502: 00000100:00100000:2.0:1788725911.779653:0:7876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.779677:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935043328 00000100:00100000:2.0:1788725911.779682:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935043328 00000100:00100000:2.0:1788725911.779708:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788725911.779715:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:7876:x1875614935043328:12345-0@lo:502: 00000100:00100000:2.0:1788725911.779862:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:7876:x1875614935043328:12345-0@lo:502: Request processed in 147us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.779876:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788725911.779905:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a005881780 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.779918:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7876:1875614935043328:0@lo:502: 00000040:00080000:2.0:1788725911.779938:0:7876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788725911.780080:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788725911.780096:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788725911.780105:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10149ae00/0xcbde9110e47c0fe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0fe8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.780116:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10149ae00/0xcbde9110e47c0fe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0fe8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725911.780125:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788725911.780128:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788725911.780131:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788725911.780154:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0fef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.780162:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0fef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.780171:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0fef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725911.780183:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935043456:0@lo:101: 00000100:00100000:2.0:1788725911.780211:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.780247:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a005881780 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.780261:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935043456 00000100:00100000:2.0:1788725911.780264:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935043456 00000100:00100000:2.0:1788725911.780296:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788725911.780303:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:5831:x1875614935043456:12345-0@lo:101: 00010000:00010000:2.0:1788725911.780312:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725911.780324:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e725c00/0xcbde9110e47c0ff6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0fef expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.780345:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e725c00/0xcbde9110e47c0ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0fef expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.780356:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e725c00/0xcbde9110e47c0ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0fef expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.780366:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725c00, rc 0) 00000100:00100000:2.0:1788725911.780480:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:5831:x1875614935043456:12345-0@lo:101: Request processed in 177us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.780486:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788725911.780518:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935043456:0@lo:101: 00010000:00010000:2.0:1788725911.780529:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0fef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0ff6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.780538:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0fef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0ff6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725911.780574:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935043584:0@lo:501: 00000100:00100000:2.0:1788725911.780599:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.780612:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a005881780 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.780623:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935043584 00000100:00100000:2.0:1788725911.780626:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935043584 00000100:00100000:2.0:1788725911.780645:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788725911.780661:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:5831:x1875614935043584:12345-0@lo:501: 00000100:00100000:2.0:1788725911.780890:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:5831:x1875614935043584:12345-0@lo:501: Request processed in 231us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.780897:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788725911.780926:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935043584:0@lo:501: 00000100:00100000:2.0:1788725911.780950:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935043712:0@lo:503: 00000100:00100000:2.0:1788725911.781057:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.781073:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a005881780 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.781086:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935043712 00000100:00100000:2.0:1788725911.781090:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935043712 00000100:00100000:2.0:1788725911.781111:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788725911.781116:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:5831:x1875614935043712:12345-0@lo:503: 00000100:00100000:2.0:1788725911.781732:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:5831:x1875614935043712:12345-0@lo:503: Request processed in 613us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.781740:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788725911.782105:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935043712:0@lo:503: 00000100:00100000:0.0:1788725911.782551:0:7877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7877:1875614935043840:0@lo:502: 00000100:00100000:0.0:1788725911.782607:0:7877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725911.782642:0:7877:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a007771d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788725911.782734:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935043840 00000100:00100000:0.0:1788725911.782740:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935043840 00000100:00100000:0.0:1788725911.782788:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788725911.782797:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:7877:x1875614935043840:12345-0@lo:502: 00000100:00100000:0.0:1788725911.783022:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:7877:x1875614935043840:12345-0@lo:502: Request processed in 226us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725911.783030:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788725911.783069:0:7877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7877:1875614935043840:0@lo:502: 00000020:01000000:0.0:1788725911.783089:0:7877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788725911.783097:0:7877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725911.783099:0:7877:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788725911.783103:0:7877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788725911.783104:0:7877:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788725911.783117:0:7877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7877:1875614935043968:0@lo:502: 00000100:00100000:0.0:1788725911.783148:0:7877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725911.783160:0:7877:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a007771d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788725911.783299:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935043968 00000100:00100000:1.0:1788725911.783304:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935043968 00000100:00100000:1.0:1788725911.783328:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788725911.783334:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:7877:x1875614935043968:12345-0@lo:502: 00000100:00100000:1.0:1788725911.783538:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:7877:x1875614935043968:12345-0@lo:502: Request processed in 204us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725911.783546:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788725911.783641:0:7877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7877:1875614935043968:0@lo:502: 00000020:01000000:0.0:1788725911.783660:0:7877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725911.783664:0:7877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725911.783665:0:7877:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788725911.783669:0:7877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788725911.783941:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788725911.783960:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788725911.784031:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0fef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0ff6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725911.784043:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0ff6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725911.784054:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788725911.784057:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91a120292000 from 30 10000000:01000000:1.0:1788725911.784059:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788725911.784087:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10149ac00/0xcbde9110e47c0ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725911.784103:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10149ac00/0xcbde9110e47c0ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725911.784113:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10149ac00/0xcbde9110e47c0ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725911.784126:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139864a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935044096:0@lo:101: 00000100:00100000:1.0:1788725911.784157:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725911.784192:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1068f30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.784283:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935044096 00000100:00100000:2.0:1788725911.784289:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935044096 00000100:00100000:2.0:1788725911.784324:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788725911.784333:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:5831:x1875614935044096:12345-0@lo:101: 00010000:00010000:2.0:1788725911.784342:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725911.784355:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e725400/0xcbde9110e47c1004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c0ffd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.784482:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e725400/0xcbde9110e47c1004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c0ffd expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.784495:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e725400/0xcbde9110e47c1004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0ffd expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.784511:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725400, rc 0) 00000100:00100000:2.0:1788725911.784556:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935044096:12345-0@lo:101: Request processed in 224us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.784562:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788725911.784640:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139864a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935044096:0@lo:101: 00010000:00010000:1.0:1788725911.784653:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10149ac00/0xcbde9110e47c0ffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1004 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725911.784663:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10149ac00/0xcbde9110e47c0ffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c1004 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725911.784712:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139864a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935044224:0@lo:501: 00000100:00100000:1.0:1788725911.784738:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725911.784775:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1068f30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.784818:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935044224 00000100:00100000:2.0:1788725911.784822:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935044224 00000100:00100000:2.0:1788725911.784884:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788725911.784892:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935044224:12345-0@lo:501: 00000100:00100000:2.0:1788725911.785186:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935044224:12345-0@lo:501: Request processed in 294us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.785193:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788725911.788124:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139864a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935044224:0@lo:501: 00000100:00100000:1.0:1788725911.788191:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139864a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935044352:0@lo:503: 00000100:00100000:1.0:1788725911.788293:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725911.788938:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1068f30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725911.792499:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935044352 00000100:00100000:0.0:1788725911.792514:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935044352 00000100:00100000:0.0:1788725911.792567:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788725911.792577:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935044352:12345-0@lo:503: 00000100:00100000:0.0:1788725911.792839:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935044352:12345-0@lo:503: Request processed in 263us (4545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725911.792854:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788725911.792928:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139864a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935044352:0@lo:503: 00000100:00100000:0.0:1788725911.793198:0:7879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7879:1875614935044480:0@lo:502: 00000100:00100000:0.0:1788725911.793269:0:7879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725911.793294:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935044480 00000100:00100000:0.0:1788725911.793299:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935044480 00000100:00100000:0.0:1788725911.793319:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788725911.793326:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:7879:x1875614935044480:12345-0@lo:502: 00000100:00100000:0.0:1788725911.793629:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:7879:x1875614935044480:12345-0@lo:502: Request processed in 302us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725911.793636:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788725911.793678:0:7879:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a007771600 going to sleep for 11 seconds 00000100:00100000:0.0:1788725911.793693:0:7879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7879:1875614935044480:0@lo:502: 00000100:00100000:0.0:1788725911.793733:0:7879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7879:1875614935044608:0@lo:502: 00000100:00100000:0.0:1788725911.793778:0:7879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725911.793801:0:7879:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a007771600 going to sleep for 11 seconds 00000100:00100000:3.0:1788725911.793860:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935044608 00000100:00100000:3.0:1788725911.793865:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935044608 00000100:00100000:3.0:1788725911.793896:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788725911.793903:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:7879:x1875614935044608:12345-0@lo:502: 00000100:00100000:3.0:1788725911.794115:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:7879:x1875614935044608:12345-0@lo:502: Request processed in 212us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725911.794122:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788725911.794294:0:7879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7879:1875614935044608:0@lo:502: 00000040:00080000:0.0:1788725911.794316:0:7879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788725911.799526:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788725911.799562:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788725911.799573:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10149ac00/0xcbde9110e47c0ffd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1004 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.799586:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10149ac00/0xcbde9110e47c0ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1004 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725911.799596:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788725911.799599:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91a120292000 from 5 10000000:01000000:2.0:1788725911.799602:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788725911.799640:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.799647:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.799669:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725911.799692:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935044736:0@lo:101: 00000100:00100000:2.0:1788725911.799763:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.799805:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12adfe3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725911.799890:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935044736 00000100:00100000:1.0:1788725911.799899:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935044736 00000100:00100000:1.0:1788725911.799948:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788725911.800474:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935044736:12345-0@lo:101: 00010000:00010000:1.0:1788725911.800491:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725911.800507:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10149aa00/0xcbde9110e47c1012 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c100b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725911.800530:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10149aa00/0xcbde9110e47c1012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c100b expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725911.800540:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10149aa00/0xcbde9110e47c1012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c100b expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725911.800549:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10149aa00, rc 0) 00000100:00100000:1.0:1788725911.800603:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935044736:12345-0@lo:101: Request processed in 640us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725911.800609:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788725911.800729:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935044736:0@lo:101: 00010000:00010000:2.0:1788725911.800744:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1012 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.800763:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c1012 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725911.800820:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935044864:0@lo:256: 00000100:00100000:2.0:1788725911.800855:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.800886:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12adfe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.800901:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935044864 00000100:00100000:2.0:1788725911.800905:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935044864 00000100:00100000:2.0:1788725911.800934:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788725911.800942:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935044864:12345-0@lo:256: 20000000:01000000:2.0:1788725911.800957:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788725911.801046:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788725911.801049:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788725911.801127:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935044864:12345-0@lo:256: Request processed in 185us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.801133:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788725911.801169:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935044864:0@lo:256: 10000000:01000000:2.0:1788725911.801210:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788725911.801235:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1012 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.801244:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1012 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725911.801251:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788725911.801253:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788725911.801256:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788725911.801273:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724e00/0xcbde9110e47c1019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.801280:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10e724e00/0xcbde9110e47c1019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.801288:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e724e00/0xcbde9110e47c1019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725911.801299:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935044992:0@lo:101: 00000100:00100000:2.0:1788725911.801322:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.801336:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12adfe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.801346:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935044992 00000100:00100000:2.0:1788725911.801349:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935044992 00000100:00100000:2.0:1788725911.801367:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788725911.801372:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935044992:12345-0@lo:101: 00010000:00010000:2.0:1788725911.801456:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725911.801466:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e725200/0xcbde9110e47c1020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c1019 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.801487:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e725200/0xcbde9110e47c1020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c1019 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.801497:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e725200/0xcbde9110e47c1020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c1019 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.801504:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725200, rc 0) 00000100:00100000:2.0:1788725911.801530:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935044992:12345-0@lo:101: Request processed in 157us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.801535:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788725911.801562:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935044992:0@lo:101: 00010000:00010000:2.0:1788725911.801572:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e724e00/0xcbde9110e47c1019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1020 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.801580:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e724e00/0xcbde9110e47c1019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c1020 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725911.801617:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935045120:0@lo:501: 00000100:00100000:2.0:1788725911.801637:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.801647:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12adfe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.801656:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935045120 00000100:00100000:2.0:1788725911.801659:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935045120 00000100:00100000:2.0:1788725911.801676:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788725911.801681:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935045120:12345-0@lo:501: 00000100:00100000:2.0:1788725911.801913:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935045120:12345-0@lo:501: Request processed in 231us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.801920:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788725911.801951:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935045120:0@lo:501: 00000100:00100000:2.0:1788725911.803146:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935045248:0@lo:503: 00000100:00100000:2.0:1788725911.803206:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.803325:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12adfe3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725911.804042:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935045248 00000100:00100000:1.0:1788725911.804052:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935045248 00000100:00100000:1.0:1788725911.804103:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788725911.804112:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935045248:12345-0@lo:503: 00000100:00100000:1.0:1788725911.804557:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935045248:12345-0@lo:503: Request processed in 445us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725911.804567:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788725911.806177:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935045248:0@lo:503: 00000100:00100000:0.0:1788725911.808384:0:7882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7882:1875614935045376:0@lo:502: 00000100:00100000:0.0:1788725911.808479:0:7882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725911.808528:0:7882:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a007771900 going to sleep for 11 seconds 00000100:00100000:1.0:1788725911.808661:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935045376 00000100:00100000:1.0:1788725911.808669:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935045376 00000100:00100000:1.0:1788725911.808717:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788725911.808728:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:7882:x1875614935045376:12345-0@lo:502: 00000100:00100000:1.0:1788725911.809089:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:7882:x1875614935045376:12345-0@lo:502: Request processed in 362us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725911.809109:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788725911.809300:0:7882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7882:1875614935045376:0@lo:502: 00000020:01000000:0.0:1788725911.809334:0:7882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788725911.809342:0:7882:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788725911.809356:0:7882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725911.809358:0:7882:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788725911.809363:0:7882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788725911.809367:0:7882:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:01000000:0.0:1788725911.809399:0:7882:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788725911.809401:0:7882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788725911.809426:0:7882:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91a0061199b8) 00000020:00000080:0.0:1788725911.809449:0:7882:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788725911.809455:0:7882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788725911.809529:0:7882:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788725911.809535:0:7882:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788725911.809541:0:7882:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbde9110e47c102e 00010000:00080000:0.0:1788725911.809568:0:7882:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a111693800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:0.0:1788725911.809817:0:7882:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788725911.810160:0:7882:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788725911.810172:0:7882:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788725911.810729:0:7882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788725911.811130:0:7882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788725911.811182:0:7882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788725911.811275:0:7882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788725911.814933:0:7883:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788725911.814943:0:7883:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788725911.816957:0:7882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788725911.817486:0:7882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788725911.817533:0:7882:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788725911.817561:0:7882:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbde9110e47c1035 00000100:00080000:2.0:1788725911.817573:0:7882:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788725911.817580:0:7882:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91a111693800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788725911.817621:0:7882:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a13b17ea00 x1875614935045504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788725911.817694:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935045504:0@lo:8: 00000100:00100000:1.0:1788725911.817781:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.817860:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935045504 00000100:00100000:2.0:1788725911.817868:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935045504 00000100:00100000:2.0:1788725911.817902:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788725911.817909:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3303:x1875614935045504:12345-0@lo:8: 00010000:00080000:2.0:1788725911.817936:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1788725911.819067:0:6683:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbde9110e47c103c 00002000:00100000:2.0:1788725911.819088:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91a1129b3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788725911.819093:0:6683:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788725911.819097:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788725911.819242:0:6683:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788725911.819480:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788725911.819515:0:6683:0:(import.c:65:import_set_state_nolock()) ffff91a0052aa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725911.820510:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1875614935045504:12345-0@lo:8: Request processed in 2593us (2723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.820525:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788725911.820567:0:7882:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788725911.820651:0:7882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788725911.820658:0:7882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725911.820660:0:7882:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788725911.820663:0:7882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788725911.820667:0:7882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725911.820668:0:7882:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788725911.820671:0:7882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788725911.820673:0:7882:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788725911.820710:0:7882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7882:1875614935045632:0@lo:502: 00000100:00100000:2.0:1788725911.820781:0:7882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.820812:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935045632 00000100:00100000:2.0:1788725911.820819:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935045632 00000100:00100000:2.0:1788725911.820860:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788725911.820869:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:7882:x1875614935045632:12345-0@lo:502: 00000100:00100000:2.0:1788725911.821279:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:7882:x1875614935045632:12345-0@lo:502: Request processed in 410us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.821287:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788725911.821342:0:7882:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1095a3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.821362:0:7882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:7882:1875614935045632:0@lo:502: 00000020:01000000:2.0:1788725911.821401:0:7882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788725911.821406:0:7882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725911.821407:0:7882:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788725911.821410:0:7882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788725911.821466:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788725911.821486:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788725911.821496:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724e00/0xcbde9110e47c1019 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1020 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.821507:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e724e00/0xcbde9110e47c1019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1020 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725911.821524:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788725911.821526:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91a103273370 from 1 10000000:01000000:2.0:1788725911.821529:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788725911.821553:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724a00/0xcbde9110e47c1043 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.821561:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10e724a00/0xcbde9110e47c1043 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.821569:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e724a00/0xcbde9110e47c1043 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725911.821580:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935045760:0@lo:101: 00000100:00100000:2.0:1788725911.821607:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.821623:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.821637:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935045760 00000100:00100000:2.0:1788725911.821642:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935045760 00000100:00100000:2.0:1788725911.821665:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788725911.821672:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935045760:12345-0@lo:101: 00010000:00010000:2.0:1788725911.821680:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725911.821692:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e724800/0xcbde9110e47c104a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c1043 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.821712:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e724800/0xcbde9110e47c104a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c1043 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.821722:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e724800/0xcbde9110e47c104a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c1043 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.821741:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724800, rc 0) 00000100:00100000:2.0:1788725911.821783:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935045760:12345-0@lo:101: Request processed in 111us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725911.821789:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788725911.821821:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935045760:0@lo:101: 00010000:00010000:2.0:1788725911.821834:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e724a00/0xcbde9110e47c1043 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c104a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.821842:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e724a00/0xcbde9110e47c1043 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c104a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725911.821883:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935045888:0@lo:501: 00000100:00100000:2.0:1788725911.821908:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.821921:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.821933:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935045888 00000100:00100000:2.0:1788725911.821936:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935045888 00000100:00100000:2.0:1788725911.821960:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788725911.822095:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935045888:12345-0@lo:501: 00000100:00100000:2.0:1788725911.822315:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935045888:12345-0@lo:501: Request processed in 223us (405us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788725911.822322:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788725911.822353:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935045888:0@lo:501: 10000000:01000000:2.0:1788725911.822440:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788725911.822446:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724a00/0xcbde9110e47c1043 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c104a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725911.822464:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e724a00/0xcbde9110e47c1043 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c104a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788725911.822959:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13b17ea00 x1875614935045504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788725921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725911.822982:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788725911.822991:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788725911.823001:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788725911.823007:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788725911.823011:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a111693800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788725911.823030:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788725911.823036:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935045504:0@lo:8: 00000004:00080000:1.0:1788725911.823065:0:7883:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788725911.823183:0:7883:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 206872966720ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788725911.870858:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788725911.926328:0:7884:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788725911.926363:0:7884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d32d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7884:1875614935046144:0@lo:7: 00000100:00100000:0.0:1788725911.926436:0:7884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725911.926493:0:7884:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a007771000 going to sleep for 11 seconds 00000100:00100000:3.0:1788725911.926585:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935046144 00000100:00100000:3.0:1788725911.926593:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935046144 00000100:00100000:3.0:1788725911.926661:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788725911.926671:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7884:x1875614935046144:12345-0@lo:7: 00000100:00080000:0.0:1788725911.929925:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725911.930166:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935046016:0@lo:13: 00000100:00100000:1.0:1788725911.930256:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725911.930430:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935046016 00000100:00100000:1.0:1788725911.930440:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935046016 00000100:00100000:1.0:1788725911.930492:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788725911.930502:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875614935046016:12345-0@lo:13: 00002000:00000024:1.0:1788725911.930532:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788725911.930585:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875614935046016:12345-0@lo:13: Request processed in 83us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725911.930593:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788725911.930644:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a141d30000 x1875614935046016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725911.930664:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935046016:0@lo:13: 00002000:00080000:3.0:1788725911.935805:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788725911.935815:0:6680:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788725911.935930:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7884:x1875614935046144:12345-0@lo:7: Request processed in 9254us (9488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725911.935942:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788725911.936015:0:7884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a141d32d80 x1875614935046144/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788725927 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725911.936031:0:7884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d32d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7884:1875614935046144:0@lo:7: 00000004:00080000:3.0:1788725911.936047:0:7884:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788725911.936093:0:7884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7884:1875614935046272:0@lo:5: 00000100:00100000:3.0:1788725911.936129:0:7884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725911.936167:0:7884:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1068f3840 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.936265:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935046272 00000100:00100000:2.0:1788725911.936272:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935046272 00000100:00100000:2.0:1788725911.936320:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788725911.936331:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7884:x1875614935046272:12345-0@lo:5: 00002000:00080000:2.0:1788725911.936360:0:6682:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788725911.936364:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788725911.936621:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7884:x1875614935046272:12345-0@lo:5: Request processed in 292us (491us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788725911.936627:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788725911.936660:0:7884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1111d8e00 x1875614935046272/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788725927 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725911.936672:0:7884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7884:1875614935046272:0@lo:5: 00000004:00080000:2.0:1788725911.936681:0:7884:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788725911.936710:0:7884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7884:1875614935046400:0@lo:700: 00000100:00100000:2.0:1788725911.936738:0:7884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.936769:0:7884:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.936787:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935046400 00000100:00100000:2.0:1788725911.936791:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935046400 00000100:00100000:2.0:1788725911.936822:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788725911.936829:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7884:x1875614935046400:12345-0@lo:700: 00000100:00100000:2.0:1788725911.936860:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6689:1875614935046528:0@lo:700: 00000100:00100000:2.0:1788725911.936909:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725911.936939:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788725911.936961:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935046528 00000100:00100000:2.0:1788725911.936965:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935046528 00000100:00100000:2.0:1788725911.936992:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788725911.936998:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6689:x1875614935046528:12345-0@lo:700: 40000000:02000000:2.0:1788725912.000178:0:5841:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788725912.009668:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6689:x1875614935046528:12345-0@lo:700: Request processed in 72660us (72749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725912.009683:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788725912.015509:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13b17d880 x1875614935046528/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788725927 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725912.015531:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6689:1875614935046528:0@lo:700: 40000000:02000000:2.0:1788725912.015546:0:6689:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1788725912.170365:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7884:x1875614935046400:12345-0@lo:700: Request processed in 233526us (233616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725912.170380:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788725912.170435:0:7884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13b17f100 x1875614935046400/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788725927 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725912.170451:0:7884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7884:1875614935046400:0@lo:700: 00000001:00080000:1.0:1788725912.171120:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788725912.171129:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:2.0:1788725912.217895:0:7884:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788725912.225272:0:7884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005961500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7884:1875614935046656:0@lo:5: 00000100:00100000:2.0:1788725912.225343:0:7884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725912.225394:0:7884:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1095a3000 going to sleep for 11 seconds 00000100:00100000:3.0:1788725912.225655:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935046656 00000100:00100000:3.0:1788725912.225663:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935046656 00000100:00100000:3.0:1788725912.225711:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788725912.225721:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7884:x1875614935046656:12345-0@lo:5: 00002000:00080000:3.0:1788725912.232546:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788725912.232567:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788725912.236933:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7884:x1875614935046656:12345-0@lo:5: Request processed in 11206us (11582us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788725912.236946:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788725912.237053:0:7884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a005961500 x1875614935046656/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788725928 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725912.237070:0:7884:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788725912.237089:0:7884:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff91a005961500 x1875614935046656/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788725928 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725912.237115:0:7884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005961500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7884:1875614935046656:0@lo:5: 00000004:00080000:0.0:1788725912.237133:0:7884:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1788725912.598247:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725913.308253:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788725913.308277:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935046784:0@lo:13: 00000100:00100000:3.0:1788725913.308344:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725913.308506:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935046784 00000100:00100000:1.0:1788725913.308524:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935046784 00000100:00100000:1.0:1788725913.308589:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788725913.308599:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935046784:12345-0@lo:13: 00002000:00000024:1.0:1788725913.308639:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788725913.308688:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935046784:12345-0@lo:13: Request processed in 90us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725913.308695:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788725913.308824:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788725913.308853:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a139867800 x1875614935046784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725913.308873:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935046784:0@lo:13: 00010000:00010000:0.0:1788725913.621684:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788725913.656531:0:7980:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788725914.646627:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725915.670967:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725916.693512:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725916.899461:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935046912:0@lo:400: 00000100:00100000:0.0:1788725916.899546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725916.899739:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935046912 00000100:00100000:3.0:1788725916.899748:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935046912 00000100:00100000:3.0:1788725916.899795:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788725916.899804:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935046912:12345-0@lo:400: 00000100:00100000:3.0:1788725916.917163:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935046912:12345-0@lo:400: Request processed in 17345us (17602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725916.917181:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788725916.919340:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935046912:0@lo:400: 00000100:00100000:0.0:1788725916.919373:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788725916.919385:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935047040:0@lo:400: 00000100:00100000:0.0:1788725916.919447:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725916.920790:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935047040 00000100:00100000:3.0:1788725916.920804:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935047040 00000100:00100000:3.0:1788725916.920869:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788725916.920891:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935047040:12345-0@lo:400: 00000100:00100000:3.0:1788725916.921251:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935047040:12345-0@lo:400: Request processed in 372us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725916.921258:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788725916.921369:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a139864700 x1875614935047040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725916.921383:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935047040:0@lo:400: 00000100:00100000:3.0:1788725916.922170:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935047168:0@lo:400: 00000100:00100000:3.0:1788725916.922439:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725916.924156:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935047552:0@lo:400: 00000100:00100000:3.0:1788725916.924343:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788725916.924350:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935047296:0@lo:400: 00000100:00100000:3.0:1788725916.924382:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725916.924417:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935047296 00000100:00100000:3.0:1788725916.924437:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935047296 00000100:00100000:3.0:1788725916.924495:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788725916.924505:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935047296:12345-0@lo:400: 00000100:00100000:3.0:1788725916.924560:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935047296:12345-0@lo:400: Request processed in 57us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725916.924568:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788725916.924591:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788725916.924618:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a139865f80 x1875614935047296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725916.924631:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935047296:0@lo:400: 00000100:00100000:3.0:1788725916.924652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725916.926472:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935047424:0@lo:400: 00000100:00100000:1.0:1788725916.926549:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725916.931477:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935047424 00000100:00100000:3.0:1788725916.931492:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935047424 00000100:00100000:3.0:1788725916.931560:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788725916.931571:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935047424:12345-0@lo:400: 00000100:00100000:3.0:1788725916.931686:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935047424:12345-0@lo:400: Request processed in 117us (5136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725916.931694:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788725916.931716:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725916.938913:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935047168 00000100:00100000:0.0:1788725916.938933:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935047168 00000100:00080000:0.0:1788725916.938992:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725916.939049:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935047552 00000100:00100000:0.0:1788725916.939053:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935047552 00000100:00080000:0.0:1788725916.939066:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725916.939087:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788725916.939096:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935047168:12345-0@lo:400: 00000100:00100000:0.0:1788725916.939197:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935047168:12345-0@lo:400: Request processed in 101us (16756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725916.939204:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788725916.939280:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a139865c00 x1875614935047168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725916.939296:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935047168:0@lo:400: 00000100:00100000:0.0:1788725916.940428:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788725916.940440:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875614935047552:12345-0@lo:400: 00000100:00100000:0.0:1788725916.940510:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875614935047552:12345-0@lo:400: Request processed in 73us (15856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725916.940518:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788725916.940556:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a139865880 x1875614935047552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725916.940570:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935047552:0@lo:400: 00010000:00080000:0.0:1788725916.944505:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a139864380 x1875614935047424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725916.944523:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935047424:0@lo:400: 00000100:00100000:0.0:1788725917.400802:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935047680:0@lo:13: 00000100:00100000:0.0:1788725917.400872:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725917.401773:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935047680 00000100:00100000:0.0:1788725917.401785:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935047680 00000100:00100000:0.0:1788725917.404954:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788725917.404977:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875614935047680:12345-0@lo:13: 00002000:00000024:0.0:1788725917.405017:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788725917.405102:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875614935047680:12345-0@lo:13: Request processed in 134us (4230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725917.405109:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788725917.406248:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a141d31180 x1875614935047680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725917.406285:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935047680:0@lo:13: 00000001:00080000:1.0:1788725917.562813:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788725917.721900:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725918.422727:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935047808:0@lo:13: 00000100:00100000:3.0:1788725918.422813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725918.422887:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935047808 00000100:00100000:3.0:1788725918.422894:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935047808 00000100:00100000:3.0:1788725918.422958:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788725918.422968:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935047808:12345-0@lo:13: 00002000:00000024:3.0:1788725918.423004:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788725918.423045:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935047808:12345-0@lo:13: Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725918.423058:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788725918.423079:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788725918.423107:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1111d9880 x1875614935047808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725918.423125:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935047808:0@lo:13: 00010000:00010000:0.0:1788725918.741572:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725919.765709:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725920.299060:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725920.299130:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914052224 00000100:00100000:2.0:1788725920.299141:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914052224 00000100:00100000:2.0:1788725920.299355:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:2.0:1788725920.299364:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1875614914052224:12345-192.168.201.42@tcp:250: 00010000:00080000:2.0:1788725920.299390:0:5828:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2306ca11-4668-43b2-bddf-879669734d27@192.168.201.42@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:2.0:1788725920.299417:0:5828:0:(genops.c:1385:class_connect()) connect: client 2306ca11-4668-43b2-bddf-879669734d27, cookie 0xcbde9110e47c1051 00000100:00080000:2.0:1788725920.299539:0:5828:0:(import.c:65:import_set_state_nolock()) ffff91a006f00000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725920.299599:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+5:2348:x1875614914052224:12345-192.168.201.42@tcp:250: Request processed in 234us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725920.299606:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:0.0:1788725920.312416:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725920.315351:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914052352 00000100:00100000:3.0:1788725920.315366:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914052352 00000100:00100000:0.0:1788725920.325316:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00100000:0.0:1788725920.325332:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+5:5579:x1875614914052352:12345-192.168.201.42@tcp:101: 00010000:00010000:0.0:1788725920.325350:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725920.325371:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a100030400/0xcbde9110e47c1058 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be90559e90 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725920.325408:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a100030400/0xcbde9110e47c1058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559e90 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725920.325420:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a100030400/0xcbde9110e47c1058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559e90 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725920.325430:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100030400, rc 0) 00000100:00100000:0.0:1788725920.325498:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+6:5579:x1875614914052352:12345-192.168.201.42@tcp:101: Request processed in 169us (13093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725920.325505:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00100000:1.0:1788725920.332960:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725920.333395:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914052480 00000100:00100000:3.0:1788725920.333406:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914052480 00000100:00100000:3.0:1788725920.333463:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:3.0:1788725920.333473:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+6:5579:x1875614914052480:12345-192.168.201.42@tcp:501: 00000100:00100000:3.0:1788725920.333835:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+6:5579:x1875614914052480:12345-192.168.201.42@tcp:501: Request processed in 362us (883us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788725920.333845:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:1.0:1788725920.343833:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725920.343958:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914052608 00000100:00100000:3.0:1788725920.343969:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914052608 00000100:00100000:3.0:1788725920.344029:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:3.0:1788725920.344049:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+6:5579:x1875614914052608:12345-192.168.201.42@tcp:101: 00010000:00010000:3.0:1788725920.344067:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725920.344085:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c105f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be90559e97 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725920.344113:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c105f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559e97 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725920.344124:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c105f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559e97 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725920.344145:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10db70a00, rc 0) 00000100:00100000:3.0:1788725920.344193:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+7:5579:x1875614914052608:12345-192.168.201.42@tcp:101: Request processed in 146us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725920.344200:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:3.0:1788725920.346331:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725920.347423:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914052736 00000100:00100000:1.0:1788725920.347437:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914052736 00000100:00100000:1.0:1788725920.347502:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:1.0:1788725920.347513:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+7:5579:x1875614914052736:12345-192.168.201.42@tcp:501: 00000100:00100000:1.0:1788725920.347801:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+8:5579:x1875614914052736:12345-192.168.201.42@tcp:501: Request processed in 288us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725920.347816:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:3.0:1788725920.351447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725920.353253:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914052864 00000100:00100000:2.0:1788725920.353271:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914052864 00000100:00100000:2.0:1788725920.353335:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:2.0:1788725920.353346:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+8:5579:x1875614914052864:12345-192.168.201.42@tcp:503: 00000100:00100000:2.0:1788725920.353732:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+8:5579:x1875614914052864:12345-192.168.201.42@tcp:503: Request processed in 387us (2292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725920.353740:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:2.0:1788725920.363956:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725920.364046:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914052992 00000100:00100000:3.0:1788725920.364057:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914052992 00000100:00100000:3.0:1788725920.364108:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:3.0:1788725920.364118:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+8:5598:x1875614914052992:12345-192.168.201.42@tcp:502: 00000100:00100000:3.0:1788725920.364444:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+8:5598:x1875614914052992:12345-192.168.201.42@tcp:502: Request processed in 325us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725920.364452:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:2.0:1788725920.414640:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725920.414722:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914053120 00000100:00100000:3.0:1788725920.414731:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914053120 00000100:00100000:3.0:1788725920.414788:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:3.0:1788725920.414798:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+8:5598:x1875614914053120:12345-192.168.201.42@tcp:502: 00000100:00100000:3.0:1788725920.415250:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+8:5598:x1875614914053120:12345-192.168.201.42@tcp:502: Request processed in 452us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725920.415260:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:1.0:1788725920.433336:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725920.435264:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914053248 00000100:00100000:3.0:1788725920.435282:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914053248 00000100:00100000:3.0:1788725920.435338:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:3.0:1788725920.435349:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+8:5579:x1875614914053248:12345-192.168.201.42@tcp:101: 00010000:00010000:3.0:1788725920.435365:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725920.435395:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10db71000/0xcbde9110e47c1066 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be90559ec1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725920.435422:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10db71000/0xcbde9110e47c1066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ec1 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725920.435433:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10db71000/0xcbde9110e47c1066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ec1 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725920.435441:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10db71000, rc 0) 00000100:00100000:3.0:1788725920.435508:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+9:5579:x1875614914053248:12345-192.168.201.42@tcp:101: Request processed in 161us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725920.435516:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:2.0:1788725920.455005:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725920.455098:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914053376 00000100:00100000:1.0:1788725920.455109:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914053376 00000100:00100000:1.0:1788725920.455168:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:1.0:1788725920.455179:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+9:5579:x1875614914053376:12345-192.168.201.42@tcp:256: 20000000:01000000:1.0:1788725920.455210:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788725920.455258:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788725920.455262:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788725920.455265:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788725920.455268:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788725920.457741:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+9:5579:x1875614914053376:12345-192.168.201.42@tcp:256: Request processed in 2553us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725920.457756:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:0.0:1788725920.478584:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725920.478763:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914053504 00000100:00100000:2.0:1788725920.478773:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914053504 00000100:00100000:2.0:1788725920.478840:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:2.0:1788725920.478998:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+9:5579:x1875614914053504:12345-192.168.201.42@tcp:101: 00010000:00010000:2.0:1788725920.479018:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725920.479112:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c106d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be90559ec8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725920.479150:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c106d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ec8 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725920.479160:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c106d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ec8 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725920.479169:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725e00, rc 0) 00000100:00100000:2.0:1788725920.479338:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:5579:x1875614914053504:12345-192.168.201.42@tcp:101: Request processed in 487us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725920.479346:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:3.0:1788725920.489381:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725920.490228:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914053632 00000100:00100000:1.0:1788725920.490240:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914053632 00000100:00100000:1.0:1788725920.490342:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:1.0:1788725920.490352:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:5579:x1875614914053632:12345-192.168.201.42@tcp:501: 00000100:00100000:1.0:1788725920.490657:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:5579:x1875614914053632:12345-192.168.201.42@tcp:501: Request processed in 305us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725920.490667:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:3.0:1788725920.496583:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725920.496629:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914053760 00000100:00100000:3.0:1788725920.496638:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914053760 00000100:00100000:3.0:1788725920.496682:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:3.0:1788725920.496692:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:5579:x1875614914053760:12345-192.168.201.42@tcp:503: 00000100:00100000:3.0:1788725920.498189:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:5579:x1875614914053760:12345-192.168.201.42@tcp:503: Request processed in 1486us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725920.498204:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:0.0:1788725920.502780:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725920.503693:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914053888 00000100:00100000:3.0:1788725920.503705:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914053888 00000100:00100000:3.0:1788725920.503764:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:3.0:1788725920.503774:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:5602:x1875614914053888:12345-192.168.201.42@tcp:502: 00000100:00100000:3.0:1788725920.506066:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:5602:x1875614914053888:12345-192.168.201.42@tcp:502: Request processed in 2282us (3286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725920.506094:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:2.0:1788725920.514142:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725920.514678:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914054016 00000100:00100000:1.0:1788725920.514689:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914054016 00000100:00100000:1.0:1788725920.514750:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:1.0:1788725920.514760:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:5602:x1875614914054016:12345-192.168.201.42@tcp:502: 00000100:00100000:1.0:1788725920.515756:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:5602:x1875614914054016:12345-192.168.201.42@tcp:502: Request processed in 993us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725920.515774:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:3.0:1788725920.520479:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725920.520733:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914054144 00000100:00100000:1.0:1788725920.520743:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914054144 00000100:00100000:1.0:1788725920.520786:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:1.0:1788725920.520793:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1875614914054144:12345-192.168.201.42@tcp:38: 00010000:00080000:1.0:1788725920.520822:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:1.0:1788725920.520863:0:5834:0:(genops.c:1385:class_connect()) connect: client 7c11f8bd-dcce-4bc6-a067-83d611fb0a24, cookie 0xcbde9110e47c1074 00000004:00100000:1.0:1788725920.521114:0:5834:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:1.0:1788725920.521119:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788725920.567772:0:5834:0:(import.c:65:import_set_state_nolock()) ffff91a13adc5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788725920.568019:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2348:x1875614914054144:12345-192.168.201.42@tcp:38: Request processed in 47223us (47545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725920.568039:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00010000:00010000:0.0:1788725920.790616:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725921.077100:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725921.077192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725921.083728:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914054272 00000100:00100000:3.0:1788725921.083743:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914054272 00000100:00080000:0.0:1788725921.083849:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725921.084866:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914054400 00000100:00100000:1.0:1788725921.084876:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914054400 00000100:00100000:1.0:1788725921.084943:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:1.0:1788725921.084954:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:0:x1875614914054272:12345-192.168.201.42@tcp:41: 00000004:00000024:1.0:1788725921.084999:0:7629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788725921.085690:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:0:x1875614914054272:12345-192.168.201.42@tcp:41: Request processed in 733us (8594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725921.085701:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:1.0:1788725921.085726:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:1.0:1788725921.085735:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:5579:x1875614914054400:12345-192.168.201.42@tcp:41: 00000004:00000024:1.0:1788725921.085752:0:7629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788725921.085776:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:5579:x1875614914054400:12345-192.168.201.42@tcp:41: Request processed in 43us (8584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725921.085795:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:0.0:1788725921.091483:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725921.091581:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914054528 00000100:00100000:1.0:1788725921.091601:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914054528 00000100:00100000:1.0:1788725921.091660:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:1.0:1788725921.091671:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:5579:x1875614914054528:12345-192.168.201.42@tcp:40: 00000100:00100000:1.0:1788725921.091771:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:5579:x1875614914054528:12345-192.168.201.42@tcp:40: Request processed in 102us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725921.091778:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:2.0:1788725921.094099:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725921.094195:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914054656 00000100:00100000:0.0:1788725921.094255:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914054656 00000100:00100000:0.0:1788725921.094308:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:0.0:1788725921.094318:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875614914054656:12345-192.168.201.42@tcp:8: 00010000:00080000:0.0:1788725921.094353:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:0.0:1788725921.094394:0:6683:0:(genops.c:1385:class_connect()) connect: client 7c11f8bd-dcce-4bc6-a067-83d611fb0a24, cookie 0xcbde9110e47c107b 00002000:00100000:0.0:1788725921.094406:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7c11f8bd-dcce-4bc6-a067-83d611fb0a24/ffff91a139f01800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788725921.094431:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788725921.094810:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788725921.094903:0:6683:0:(import.c:65:import_set_state_nolock()) ffff91a139f00000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788725921.094981:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2348:x1875614914054656:12345-192.168.201.42@tcp:8: Request processed in 663us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725921.094990:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:0.0:1788725921.097082:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725921.097129:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725921.097259:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914054784 00000100:00100000:1.0:1788725921.097269:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914054784 00000100:00100000:1.0:1788725921.097316:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:1.0:1788725921.097324:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875614914054784:12345-192.168.201.42@tcp:8: 00010000:00080000:1.0:1788725921.097358:0:6682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:1.0:1788725921.097412:0:6682:0:(genops.c:1385:class_connect()) connect: client 7c11f8bd-dcce-4bc6-a067-83d611fb0a24, cookie 0xcbde9110e47c1082 00002000:00100000:1.0:1788725921.097424:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7c11f8bd-dcce-4bc6-a067-83d611fb0a24/ffff91a141af8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788725921.097449:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788725921.097803:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788725921.097847:0:6682:0:(import.c:65:import_set_state_nolock()) ffff91a141af9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788725921.098047:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2348:x1875614914054784:12345-192.168.201.42@tcp:8: Request processed in 721us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725921.098055:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:2.0:1788725921.098332:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914054912 00000100:00100000:2.0:1788725921.098338:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914054912 00000100:00100000:2.0:1788725921.098387:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:2.0:1788725921.098395:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:5579:x1875614914054912:12345-192.168.201.42@tcp:33: 00000100:00100000:0.0:1788725921.105548:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725921.105717:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914055040 00000100:00100000:3.0:1788725921.105730:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914055040 00000100:00100000:3.0:1788725921.105824:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:3.0:1788725921.105835:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:2350:x1875614914055040:12345-192.168.201.42@tcp:400: 00000100:00100000:3.0:1788725921.106021:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:2350:x1875614914055040:12345-192.168.201.42@tcp:400: Request processed in 187us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725921.106030:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 127 00000004:00080000:1.0:1788725921.116016:0:5837:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 17564us 00000004:00200000:1.0:1788725921.129626:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788725921.129750:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:5579:x1875614914054912:12345-192.168.201.42@tcp:33: Request processed in 31348us (32612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725921.129772:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:2.0:1788725921.456752:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725921.457140:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914055168 00000100:00100000:1.0:1788725921.457151:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914055168 00000100:00100000:1.0:1788725921.457251:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:1.0:1788725921.457264:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:5619:x1875614914055168:12345-192.168.201.42@tcp:101: 00010000:00010000:1.0:1788725921.457285:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725921.457367:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c1089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559ef2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725921.457430:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725921.457444:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725921.457459:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725921.457493:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788725921.457511:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788725921.457528:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725921.457555:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c1089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ef2 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725921.457575:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ef2 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725921.457614:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d600) 00010000:00010000:1.0:1788725921.457617:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788725921.457621:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10149a800, rc 0) 00000100:00100000:1.0:1788725921.457689:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:5619:x1875614914055168:12345-192.168.201.42@tcp:101: Request processed in 428us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725921.457696:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00010000:00010000:1.0:1788725921.813558:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725922.006141:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935048320:0@lo:400: 00000100:00100000:3.0:1788725922.006244:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725922.006323:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788725922.006329:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935048192:0@lo:400: 00000100:00100000:3.0:1788725922.006358:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725922.006399:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935048320 00000100:00100000:3.0:1788725922.006407:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935048320 00000100:00100000:3.0:1788725922.006486:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788725922.006497:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935048320:12345-0@lo:400: 00000100:00100000:3.0:1788725922.006562:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935048320:12345-0@lo:400: Request processed in 67us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725922.006569:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788725922.006603:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935048192 00000100:00100000:3.0:1788725922.006607:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935048192 00000100:00100000:3.0:1788725922.006634:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788725922.006642:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935048192:12345-0@lo:400: 00000100:00100000:3.0:1788725922.006691:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935048192:12345-0@lo:400: Request processed in 50us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725922.006698:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788725922.006715:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788725922.006719:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788725922.006743:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a611c00 x1875614935048192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725922.006757:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935048192:0@lo:400: 00000100:00100000:3.0:1788725922.006770:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935048320:0@lo:400: 00000100:00100000:1.0:1788725922.007569:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935048064:0@lo:400: 00000100:00100000:1.0:1788725922.007629:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725922.007662:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935048576:0@lo:400: 00000100:00100000:1.0:1788725922.007687:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725922.007717:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788725922.007725:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935047936:0@lo:400: 00000100:00100000:1.0:1788725922.007751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725922.007773:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935048448:0@lo:400: 00000100:00100000:1.0:1788725922.007804:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725922.007837:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935047936 00000100:00100000:1.0:1788725922.007842:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935047936 00000100:00100000:1.0:1788725922.007880:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788725922.007888:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935047936:12345-0@lo:400: 00000100:00100000:1.0:1788725922.007929:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935047936:12345-0@lo:400: Request processed in 42us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725922.007936:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788725922.007979:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935047936:0@lo:400: 00000100:00100000:1.0:1788725922.008012:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935048064 00000100:00100000:1.0:1788725922.008016:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935048064 00000100:00100000:1.0:1788725922.008037:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935048448 00000100:00100000:1.0:1788725922.008039:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935048448 00000100:00100000:1.0:1788725922.008060:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788725922.008066:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935048064:12345-0@lo:400: 00000100:00100000:1.0:1788725922.008119:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935048064:12345-0@lo:400: Request processed in 53us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725922.008126:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788725922.008137:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788725922.008143:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935048448:12345-0@lo:400: 00000100:00100000:1.0:1788725922.008170:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935048448:12345-0@lo:400: Request processed in 27us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725922.008175:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788725922.008199:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935048448:0@lo:400: 00000100:00100000:1.0:1788725922.008245:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935048064:0@lo:400: 00000100:00100000:1.0:1788725922.008271:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935048576 00000100:00100000:1.0:1788725922.008275:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935048576 00000100:00100000:1.0:1788725922.008298:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788725922.008637:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139865880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935048576:12345-0@lo:400: 00000100:00100000:1.0:1788725922.008680:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139865880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935048576:12345-0@lo:400: Request processed in 376us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725922.008686:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788725922.008714:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a612680 x1875614935048576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725922.008723:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788725922.008745:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935048576:0@lo:400: 00000100:00080000:3.0:1788725922.009204:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788725922.009210:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725922.517554:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935048704:0@lo:13: 00000100:00100000:2.0:1788725922.517635:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725922.517772:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935048704 00000100:00100000:0.0:1788725922.517780:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935048704 00000100:00100000:0.0:1788725922.517836:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788725922.517846:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935048704:12345-0@lo:13: 00002000:00000024:0.0:1788725922.517867:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788725922.517919:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935048704:12345-0@lo:13: Request processed in 75us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725922.517927:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788725922.518054:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a141d30a80 x1875614935048704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725922.518071:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935048704:0@lo:13: 00010000:00010000:0.0:1788725922.837386:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725923.542068:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935048832:0@lo:13: 00000100:00100000:0.0:1788725923.542181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725923.542573:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935048832 00000100:00100000:3.0:1788725923.542589:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935048832 00000100:00100000:3.0:1788725923.542657:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788725923.542678:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935048832:12345-0@lo:13: 00002000:00000024:3.0:1788725923.542730:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788725923.542811:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935048832:12345-0@lo:13: Request processed in 145us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725923.542819:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788725923.544386:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a611500 x1875614935048832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725923.544421:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935048832:0@lo:13: 00010000:00010000:1.0:1788725923.862715:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725924.238096:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725924.238306:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914055296 00000100:00100000:2.0:1788725924.238317:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914055296 00000100:00100000:2.0:1788725924.238396:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:2.0:1788725924.238407:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:5671:x1875614914055296:12345-192.168.201.42@tcp:41: 00000004:00000024:2.0:1788725924.238463:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788725924.238531:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:5671:x1875614914055296:12345-192.168.201.42@tcp:41: Request processed in 125us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725924.238538:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00080000:3.0:1788725924.238773:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725924.248425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725924.248525:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914055424 00000100:00100000:1.0:1788725924.248535:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914055424 00000100:00100000:1.0:1788725924.248621:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:1.0:1788725924.248632:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:5671:x1875614914055424:12345-192.168.201.42@tcp:13: 00002000:00000024:1.0:1788725924.248657:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788725924.248720:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:5671:x1875614914055424:12345-192.168.201.42@tcp:13: Request processed in 90us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725924.248727:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00080000:3.0:1788725924.249040:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725924.255461:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725924.255582:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914055552 00000100:00100000:1.0:1788725924.255593:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914055552 00000100:00100000:1.0:1788725924.255678:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00080000:3.0:1788725924.255687:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725924.255701:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:5671:x1875614914055552:12345-192.168.201.42@tcp:13: 00002000:00000024:1.0:1788725924.255751:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788725924.255828:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:5671:x1875614914055552:12345-192.168.201.42@tcp:13: Request processed in 140us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725924.255835:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00010000:00010000:0.0:1788725924.888341:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788725925.697453:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000001:00100000:0.0:1788725925.716942:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000001:00100000:1.0:1788725925.781838:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00010000:00010000:1.0:1788725925.912121:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725926.322901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725926.322940:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725926.322970:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725926.323011:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725926.323042:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914055808 00000100:00100000:0.0:1788725926.323051:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914055808 00000100:00100000:0.0:1788725926.323114:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:0.0:1788725926.323126:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914055808:12345-192.168.201.42@tcp:400: 00000100:00100000:0.0:1788725926.323204:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914055808:12345-192.168.201.42@tcp:400: Request processed in 81us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725926.323212:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:0.0:1788725926.323256:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914056064 00000100:00100000:0.0:1788725926.323259:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914056064 00000100:00100000:0.0:1788725926.323284:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914055936 00000100:00100000:0.0:1788725926.323287:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914055936 00000100:00100000:0.0:1788725926.323320:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:0.0:1788725926.323329:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2350:x1875614914056064:12345-192.168.201.42@tcp:400: 00000100:00100000:0.0:1788725926.323357:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2350:x1875614914056064:12345-192.168.201.42@tcp:400: Request processed in 30us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725926.323363:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:0.0:1788725926.323389:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:0.0:1788725926.323395:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2350:x1875614914055936:12345-192.168.201.42@tcp:400: 00000100:00100000:0.0:1788725926.323423:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2350:x1875614914055936:12345-192.168.201.42@tcp:400: Request processed in 29us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725926.323430:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00080000:0.0:1788725926.323449:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788725926.323453:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788725926.323455:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725926.335846:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914055680 00000100:00100000:1.0:1788725926.335863:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914055680 00000100:00100000:1.0:1788725926.335921:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:1.0:1788725926.335933:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:2350:x1875614914055680:12345-192.168.201.42@tcp:400: 00000100:00100000:1.0:1788725926.336026:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:2350:x1875614914055680:12345-192.168.201.42@tcp:400: Request processed in 94us (13053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725926.336040:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 129 00010000:00010000:0.0:1788725926.934968:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725927.126321:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935049088:0@lo:400: 00000100:00100000:3.0:1788725927.126397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725927.126452:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935049600:0@lo:400: 00000100:00100000:3.0:1788725927.126479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725927.126539:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788725927.126545:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935048960:0@lo:400: 00000100:00100000:3.0:1788725927.126576:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725927.126608:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935049472:0@lo:400: 00000100:00100000:3.0:1788725927.126630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725927.126659:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935049216:0@lo:400: 00000100:00100000:3.0:1788725927.126683:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725927.126700:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788725927.126705:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935049344:0@lo:400: 00000100:00100000:3.0:1788725927.126726:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725927.129450:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935049088 00000100:00100000:3.0:1788725927.129465:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935049088 00000100:00100000:3.0:1788725927.129531:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935049472 00000100:00100000:3.0:1788725927.129535:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935049472 00000100:00100000:3.0:1788725927.129558:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935049344 00000100:00100000:3.0:1788725927.129562:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935049344 00000100:00100000:3.0:1788725927.129581:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788725927.129591:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935049088:12345-0@lo:400: 00000100:00100000:3.0:1788725927.129677:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935049088:12345-0@lo:400: Request processed in 88us (3279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725927.129684:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788725927.129702:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788725927.129708:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935049472:12345-0@lo:400: 00000100:00100000:3.0:1788725927.129815:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935049472:12345-0@lo:400: Request processed in 106us (3182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725927.129822:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788725927.129835:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788725927.129843:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935049344:12345-0@lo:400: 00000100:00100000:3.0:1788725927.129892:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935049344:12345-0@lo:400: Request processed in 50us (3164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725927.129898:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788725927.129942:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935049344:0@lo:400: 00000100:00100000:3.0:1788725927.129984:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935049472:0@lo:400: 00000100:00100000:3.0:1788725927.130003:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935049088:0@lo:400: 00000100:00100000:3.0:1788725927.130047:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935048960 00000100:00100000:3.0:1788725927.130052:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935048960 00000100:00100000:3.0:1788725927.130080:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788725927.130087:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935048960:12345-0@lo:400: 00000100:00100000:3.0:1788725927.130124:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935048960:12345-0@lo:400: Request processed in 37us (3546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725927.130129:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788725927.130164:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935048960:0@lo:400: 00000100:00100000:0.0:1788725927.132595:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935049600 00000100:00100000:0.0:1788725927.132608:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935049600 00000100:00100000:0.0:1788725927.132651:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935049216 00000100:00100000:0.0:1788725927.132655:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935049216 00000100:00100000:0.0:1788725927.132674:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788725927.132685:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935049600:12345-0@lo:400: 00000100:00100000:0.0:1788725927.132778:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935049600:12345-0@lo:400: Request processed in 95us (6298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725927.132798:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788725927.132815:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788725927.132822:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935049216:12345-0@lo:400: 00000100:00100000:0.0:1788725927.132862:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935049216:12345-0@lo:400: Request processed in 40us (6177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725927.132869:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788725927.132883:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788725927.132890:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788725927.132893:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788725927.132909:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a613800 x1875614935049216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788725927.132925:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a610000 x1875614935049600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725927.132925:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935049216:0@lo:400: 00000100:00100000:3.0:1788725927.132941:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935049600:0@lo:400: 00000100:00100000:3.0:1788725927.639324:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935049728:0@lo:13: 00000100:00100000:3.0:1788725927.639409:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725927.639549:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935049728 00000100:00100000:2.0:1788725927.639558:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935049728 00000100:00100000:2.0:1788725927.639613:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788725927.639623:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935049728:12345-0@lo:13: 00002000:00000024:2.0:1788725927.639661:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788725927.639719:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935049728:12345-0@lo:13: Request processed in 96us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725927.639726:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788725927.639769:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a005963800 x1875614935049728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725927.639788:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935049728:0@lo:13: 00000001:02000400:1.0:1788725927.917915:0:8285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788725927.959475:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725928.661587:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935049856:0@lo:13: 00000100:00100000:1.0:1788725928.661664:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725928.661839:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935049856 00000100:00100000:0.0:1788725928.661861:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935049856 00000100:00100000:0.0:1788725928.661909:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788725928.661918:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935049856:12345-0@lo:13: 00002000:00000024:0.0:1788725928.661956:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788725928.662011:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935049856:12345-0@lo:13: Request processed in 94us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725928.662018:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788725928.662200:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a611c00 x1875614935049856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725928.662250:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935049856:0@lo:13: 00010000:00010000:2.0:1788725928.985494:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725930.010256:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725931.029527:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725931.436515:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725931.436562:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725931.436602:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725931.436793:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914056448 00000100:00100000:3.0:1788725931.436803:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914056448 00000100:00100000:3.0:1788725931.436878:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:3.0:1788725931.436904:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914056448:12345-192.168.201.42@tcp:400: 00000100:00100000:3.0:1788725931.436982:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914056448:12345-192.168.201.42@tcp:400: Request processed in 81us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725931.436991:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00080000:3.0:1788725931.437016:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725931.437399:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725931.437435:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914056576 00000100:00100000:0.0:1788725931.437440:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914056576 00000100:00100000:0.0:1788725931.437472:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:0.0:1788725931.437479:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914056576:12345-192.168.201.42@tcp:400: 00000100:00100000:0.0:1788725931.437511:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914056576:12345-192.168.201.42@tcp:400: Request processed in 32us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725931.437517:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00080000:0.0:1788725931.437530:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725931.437673:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914056192 00000100:00100000:1.0:1788725931.437679:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914056192 00000100:00100000:1.0:1788725931.437719:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:1.0:1788725931.437727:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:2351:x1875614914056192:12345-192.168.201.42@tcp:400: 00000100:00100000:1.0:1788725931.437756:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:2351:x1875614914056192:12345-192.168.201.42@tcp:400: Request processed in 30us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725931.437763:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:2.0:1788725931.437908:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914056320 00000100:00100000:2.0:1788725931.437914:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914056320 00000100:00100000:2.0:1788725931.437962:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:2.0:1788725931.437969:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2351:x1875614914056320:12345-192.168.201.42@tcp:400: 00000100:00100000:2.0:1788725931.438003:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2351:x1875614914056320:12345-192.168.201.42@tcp:400: Request processed in 35us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725931.438009:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00080000:1.0:1788725931.438396:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788725932.055473:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725932.245781:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935050112:0@lo:400: 00000100:00100000:3.0:1788725932.245860:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.245911:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935050624:0@lo:400: 00000100:00100000:3.0:1788725932.245937:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.245966:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788725932.245972:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935049984:0@lo:400: 00000100:00100000:3.0:1788725932.245998:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.246019:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935050496:0@lo:400: 00000100:00100000:3.0:1788725932.246042:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.246067:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935050368:0@lo:400: 00000100:00100000:3.0:1788725932.246105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.246127:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788725932.246135:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935050240:0@lo:400: 00000100:00100000:3.0:1788725932.246158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.246188:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935050112 00000100:00100000:3.0:1788725932.246195:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935050112 00000100:00100000:3.0:1788725932.246382:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935050496 00000100:00100000:3.0:1788725932.246386:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935050496 00000100:00100000:1.0:1788725932.247298:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935050368 00000100:00100000:1.0:1788725932.247308:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935050368 00000100:00100000:1.0:1788725932.247346:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788725932.247357:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935050112:12345-0@lo:400: 00000100:00100000:1.0:1788725932.247452:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935050112:12345-0@lo:400: Request processed in 97us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725932.247470:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788725932.247490:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788725932.247496:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935050368:12345-0@lo:400: 00000100:00100000:1.0:1788725932.247532:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935050368:12345-0@lo:400: Request processed in 37us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725932.247546:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788725932.247567:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935050624 00000100:00100000:1.0:1788725932.247571:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935050624 00000100:00100000:1.0:1788725932.247603:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935050240 00000100:00100000:1.0:1788725932.247606:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935050240 00000100:00100000:1.0:1788725932.247637:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788725932.247643:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935050624:12345-0@lo:400: 00000100:00100000:1.0:1788725932.247679:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935050624:12345-0@lo:400: Request processed in 35us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725932.247685:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788725932.247696:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788725932.247702:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935050240:12345-0@lo:400: 00000100:00100000:1.0:1788725932.247732:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935050240:12345-0@lo:400: Request processed in 30us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725932.247738:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788725932.247760:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935049984 00000100:00100000:1.0:1788725932.247764:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935049984 00000100:00100000:1.0:1788725932.247788:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788725932.247795:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935049984:12345-0@lo:400: 00000100:00100000:1.0:1788725932.247827:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935049984:12345-0@lo:400: Request processed in 32us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725932.247832:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788725932.248300:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788725932.248311:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935050496:12345-0@lo:400: 00000100:00100000:3.0:1788725932.248351:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935050496:12345-0@lo:400: Request processed in 44us (2308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.248365:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788725932.248385:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788725932.248390:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788725932.248392:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788725932.248440:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a610700 x1875614935050240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725932.248464:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935050240:0@lo:400: 00000100:00100000:3.0:1788725932.248479:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935050368:0@lo:400: 00000100:00100000:3.0:1788725932.248513:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935049984:0@lo:400: 00000100:00100000:3.0:1788725932.248525:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935050496:0@lo:400: 00000100:00100000:3.0:1788725932.248536:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935050112:0@lo:400: 00010000:00080000:3.0:1788725932.248547:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a610e00 x1875614935050624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725932.248556:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935050624:0@lo:400: 00000020:00000080:3.0:1788725932.287070:0:8433:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc45518260 20000000:00000080:3.0:1788725932.287096:0:8433:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91a13a06b800 uarg=0000000000000000 20000000:01000000:3.0:1788725932.287141:0:8433:0:(mgs_llog.c:2009:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788725932.287143:0:8433:0:(mgs_llog.c:6072:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788725932.287146:0:8433:0:(mgs_llog.c:6103:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788725932.287276:0:8433:0:(mgs_llog.c:4751:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788725932.287282:0:8433:0:(mgs_llog.c:4184:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788725932.287298:0:8433:0:(mgs_llog.c:153:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788725932.287301:0:8433:0:(mgs_llog.c:153:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788725932.288025:0:8433:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788725932.288030:0:8433:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788725932.291783:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788725932.292479:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788725932.292536:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788725932.292589:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788725932.292606:0:8433:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788725932.292608:0:8433:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788725932.298375:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788725932.299171:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788725932.299297:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788725932.299339:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788725932.299354:0:8433:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788725932.299357:0:8433:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788725932.301560:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788725932.302045:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788725932.302118:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788725932.302158:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1788725932.302174:0:8433:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788725932.302183:0:8433:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788725932.304338:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788725932.305438:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788725932.305501:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788725932.305541:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1788725932.305562:0:8433:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788725932.305585:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c1097 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.305606:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0f8d expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.305614:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0fbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0fb7 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.305731:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10e724400/0xcbde9110e47c0fe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0fe1 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.305740:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10e725c00/0xcbde9110e47c0ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0fef expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.305747:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10e725400/0xcbde9110e47c1004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0ffd expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.305755:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10e725200/0xcbde9110e47c1020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c1019 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.305761:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10e724800/0xcbde9110e47c104a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c1043 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.305770:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a100030400/0xcbde9110e47c1058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559e90 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.305788:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c105f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559e97 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.305796:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c1097 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.305835:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c105f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be90559e97 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.305852:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c105f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559e97 expref: 9 pid: 5829 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725932.305866:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139867100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935050752:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788725932.306177:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a100030400/0xcbde9110e47c1058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be90559e90 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.306186:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a100030400/0xcbde9110e47c1058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559e90 expref: 9 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725932.306195:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139867800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935050880:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788725932.306255:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10e724800/0xcbde9110e47c104a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c1043 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.306264:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a10e724800/0xcbde9110e47c104a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c1043 expref: 18 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725932.306274:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139864a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935051008:0@lo:104: 00000100:00100000:1.0:1788725932.306317:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788725932.306362:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10e725200/0xcbde9110e47c1020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c1019 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.306371:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a10e725200/0xcbde9110e47c1020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c1019 expref: 18 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725932.306379:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935051136:0@lo:104: 00010000:00010000:1.0:1788725932.306403:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10e725400/0xcbde9110e47c1004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0ffd expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.306424:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a10e725400/0xcbde9110e47c1004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0ffd expref: 18 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725932.306432:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935051264:0@lo:104: 00010000:00010000:1.0:1788725932.306456:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10e725c00/0xcbde9110e47c0ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0fef expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.306463:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a10e725c00/0xcbde9110e47c0ff6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0fef expref: 18 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725932.306482:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935051392:0@lo:104: 00010000:00010000:1.0:1788725932.306506:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10e724400/0xcbde9110e47c0fe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0fe1 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.306514:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a10e724400/0xcbde9110e47c0fe8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0fe1 expref: 18 pid: 5828 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725932.306521:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935051520:0@lo:104: 00010000:00010000:1.0:1788725932.306544:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0fbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0fb7 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.306562:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0fbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0fb7 expref: 18 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725932.306571:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935051648:0@lo:104: 00010000:00010000:1.0:1788725932.306607:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0f8d expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.306615:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0f8d expref: 18 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725932.306634:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111615f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935051776:0@lo:104: 00000100:00100000:1.0:1788725932.306652:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1033489c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725932.306818:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788725932.306839:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.306866:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.306875:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.306896:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.306908:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.306922:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.306932:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935051008 00000100:00100000:3.0:1788725932.306939:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935051008 00000100:00100000:3.0:1788725932.307152:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935051136 00000100:00100000:3.0:1788725932.307157:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935051136 00000100:00100000:3.0:1788725932.307168:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935051264 00000100:00100000:3.0:1788725932.307170:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935051264 00000100:00100000:3.0:1788725932.307176:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935051392 00000100:00100000:3.0:1788725932.307178:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935051392 00000100:00100000:3.0:1788725932.307185:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935051520 00000100:00100000:3.0:1788725932.307187:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935051520 00000100:00100000:3.0:1788725932.307195:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935051648 00000100:00100000:3.0:1788725932.307197:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935051648 00000100:00100000:3.0:1788725932.307206:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935051776 00000100:00100000:3.0:1788725932.307208:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935051776 00000100:00100000:3.0:1788725932.307251:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788725932.307269:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a110a47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+9:8433:x1875614935051008:12345-0@lo:104: 00010000:00010000:3.0:1788725932.307283:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10e724a00/0xcbde9110e47c1043 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c104a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.307349:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788725932.307355:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a110a47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+9:8433:x1875614935051008:12345-0@lo:104: Request processed in 89us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.307363:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788725932.307399:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788725932.307415:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+8:8433:x1875614935051136:12345-0@lo:104: 00010000:00010000:3.0:1788725932.307424:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10e724e00/0xcbde9110e47c1019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c1020 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.307463:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788725932.307468:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+8:8433:x1875614935051136:12345-0@lo:104: Request processed in 64us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.307474:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788725932.307487:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788725932.307492:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111610a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+7:8433:x1875614935051264:12345-0@lo:104: 00010000:00010000:3.0:1788725932.307499:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10149ac00/0xcbde9110e47c0ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c1004 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.307520:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788725932.307525:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111610a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+7:8433:x1875614935051264:12345-0@lo:104: Request processed in 33us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.307530:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788725932.307538:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788725932.307549:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+6:8433:x1875614935051392:12345-0@lo:104: 00010000:00010000:3.0:1788725932.307556:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0ff6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.307578:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788725932.307582:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+6:8433:x1875614935051392:12345-0@lo:104: Request processed in 35us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.307587:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788725932.307597:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788725932.307602:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+5:8433:x1875614935051520:12345-0@lo:104: 00010000:00010000:3.0:1788725932.307607:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10149ae00/0xcbde9110e47c0fe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0fe8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725932.307741:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139864a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935051008:0@lo:104: 00000100:00100000:0.0:1788725932.307752:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935051136:0@lo:104: 00000100:00100000:0.0:1788725932.307758:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935051264:0@lo:104: 00000100:00100000:0.0:1788725932.307765:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935051392:0@lo:104: 00010000:00010000:3.0:1788725932.307929:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788725932.307935:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+5:8433:x1875614935051520:12345-0@lo:104: Request processed in 333us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.307942:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788725932.307954:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788725932.307959:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111613480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+4:8433:x1875614935051648:12345-0@lo:104: 00010000:00010000:3.0:1788725932.307967:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c0fb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0fbe expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.307991:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788725932.307995:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111613480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+4:8433:x1875614935051648:12345-0@lo:104: Request processed in 37us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.308001:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788725932.308009:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788725932.308019:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:8433:x1875614935051776:12345-0@lo:104: 00010000:00010000:3.0:1788725932.308026:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0f94 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308048:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788725932.308052:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:8433:x1875614935051776:12345-0@lo:104: Request processed in 34us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.308057:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1788725932.308072:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788725932.308078:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e724a00/0xcbde9110e47c1043 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c104a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308085:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724a00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:3.0:1788725932.308089:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724a00/0xcbde9110e47c1043 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c104a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308098:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e724a00/0xcbde9110e47c1043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c104a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725932.308106:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724a00/0xcbde9110e47c1043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c104a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725932.308112:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725932.308142:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e724a00/0xcbde9110e47c1043 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c104a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308147:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725932.308163:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e724a00/0xcbde9110e47c1043 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c104a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308181:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e724a00/0xcbde9110e47c1043 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c104a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308195:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788725932.308198:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e724e00/0xcbde9110e47c1019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c1020 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308203:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724e00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:3.0:1788725932.308206:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724e00/0xcbde9110e47c1019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c1020 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308213:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e724e00/0xcbde9110e47c1019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c1020 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725932.308249:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724e00/0xcbde9110e47c1019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c1020 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725932.308255:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725932.308269:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e724e00/0xcbde9110e47c1019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c1020 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308275:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725932.308280:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e724e00/0xcbde9110e47c1019 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c1020 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308286:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e724e00/0xcbde9110e47c1019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c1020 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308295:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788725932.308304:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10149ac00/0xcbde9110e47c0ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c1004 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308309:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149ac00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:3.0:1788725932.308312:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10149ac00/0xcbde9110e47c0ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c1004 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308318:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10149ac00/0xcbde9110e47c0ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c1004 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725932.308324:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10149ac00/0xcbde9110e47c0ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c1004 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725932.308329:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725932.308342:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10149ac00/0xcbde9110e47c0ffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c1004 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308347:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725932.308363:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10149ac00/0xcbde9110e47c0ffd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c1004 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308369:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10149ac00/0xcbde9110e47c0ffd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c1004 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308378:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788725932.308381:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0ff6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308386:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725600 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:3.0:1788725932.308389:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0ff6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308418:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0ff6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725932.308425:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0ff6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725932.308431:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725932.308444:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0fef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0ff6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308449:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725932.308455:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0fef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0ff6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308461:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c0fef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0ff6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308471:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788725932.308474:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10149ae00/0xcbde9110e47c0fe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0fe8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308479:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149ae00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:3.0:1788725932.308482:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10149ae00/0xcbde9110e47c0fe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0fe8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308488:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10149ae00/0xcbde9110e47c0fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0fe8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725932.308495:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10149ae00/0xcbde9110e47c0fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0fe8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725932.308506:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725932.308518:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10149ae00/0xcbde9110e47c0fe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0fe8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308523:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725932.308527:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10149ae00/0xcbde9110e47c0fe1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0fe8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308533:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10149ae00/0xcbde9110e47c0fe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0fe8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308542:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788725932.308545:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c0fb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0fbe expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308550:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725800 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:3.0:1788725932.308553:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c0fb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0fbe expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308560:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c0fb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0fbe expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725932.308566:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c0fb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0fbe expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725932.308571:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725932.308580:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c0fb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0fbe expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308586:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725932.308594:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c0fb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0fbe expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308600:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c0fb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0fbe expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308608:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725932.308611:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0f94 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308629:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149b200 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:3.0:1788725932.308632:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0f94 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308639:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0f94 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725932.308645:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0f94 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725932.308650:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725932.308662:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0f94 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308667:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725932.308671:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0f94 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308677:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10149b200/0xcbde9110e47c0f8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0f94 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.308691:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725932.308697:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725932.308699:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725932.308708:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725932.308730:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935051904:0@lo:103: 00000100:00100000:3.0:1788725932.308773:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.308808:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935052416:0@lo:103: 00000100:00100000:3.0:1788725932.308828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.308848:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788725932.308853:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935052032:0@lo:103: 00000100:00100000:3.0:1788725932.308873:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.308890:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935052544:0@lo:103: 00000100:00100000:3.0:1788725932.308910:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.308941:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935052160:0@lo:103: 00000100:00100000:3.0:1788725932.308959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.308968:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935052672:0@lo:103: 00000100:00100000:3.0:1788725932.308983:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.308992:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725932.308996:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935052288:0@lo:103: 00000100:00100000:3.0:1788725932.309010:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725932.309029:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935051904 00000100:00100000:3.0:1788725932.309034:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935051904 00010000:00010000:3.0:1788725932.309056:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10e724800/0xcbde9110e47c104a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c1043 expref: 19 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725932.309071:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935052416 00000100:00100000:3.0:1788725932.309073:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935052416 00010000:00010000:3.0:1788725932.309082:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10e724400/0xcbde9110e47c0fe8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0fe1 expref: 20 pid: 5828 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725932.309104:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935052032 00000100:00100000:3.0:1788725932.309107:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935052032 00010000:00010000:3.0:1788725932.309117:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10e725200/0xcbde9110e47c1020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c1019 expref: 21 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725932.309126:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935052544 00000100:00100000:3.0:1788725932.309128:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935052544 00010000:00010000:3.0:1788725932.309136:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0fbe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0fb7 expref: 22 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725932.309145:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935052160 00000100:00100000:3.0:1788725932.309147:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935052160 00010000:00010000:3.0:1788725932.309156:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10e725400/0xcbde9110e47c1004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0ffd expref: 23 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725932.309164:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935052672 00000100:00100000:3.0:1788725932.309166:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935052672 00010000:00010000:3.0:1788725932.309174:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f94 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0f8d expref: 24 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725932.309182:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935052288 00000100:00100000:3.0:1788725932.309184:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935052288 00010000:00010000:3.0:1788725932.309192:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10e725c00/0xcbde9110e47c0ff6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0fef expref: 25 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725932.309203:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788725932.309209:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1202a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+25:3304:x1875614935051904:12345-0@lo:103: 00010000:00010000:3.0:1788725932.309241:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725932.309247:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10e724800/0xcbde9110e47c104a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c1043 expref: 25 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309266:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10e724800/0xcbde9110e47c104a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c1043 expref: 25 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309278:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e724800/0xcbde9110e47c104a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c1043 expref: 25 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309291:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725932.309323:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1202a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+24:3304:x1875614935051904:12345-0@lo:103: Request processed in 114us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.309329:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788725932.309374:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788725932.309380:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+23:3304:x1875614935052416:12345-0@lo:103: 00010000:00010000:3.0:1788725932.309386:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725932.309390:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10e724400/0xcbde9110e47c0fe8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0fe1 expref: 23 pid: 5828 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309398:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10e724400/0xcbde9110e47c0fe8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0fe1 expref: 23 pid: 5828 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309421:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725932.309443:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+23:3304:x1875614935052416:12345-0@lo:103: Request processed in 63us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.309448:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788725932.309462:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788725932.309468:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+22:3304:x1875614935052032:12345-0@lo:103: 00010000:00010000:3.0:1788725932.309475:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725932.309479:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10e725200/0xcbde9110e47c1020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c1019 expref: 22 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309493:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10e725200/0xcbde9110e47c1020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c1019 expref: 22 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309503:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e725200/0xcbde9110e47c1020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c1019 expref: 22 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309512:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725932.309534:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+21:3304:x1875614935052032:12345-0@lo:103: Request processed in 67us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.309540:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788725932.309552:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788725932.309558:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+20:3304:x1875614935052544:12345-0@lo:103: 00010000:00010000:3.0:1788725932.309565:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725932.309569:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0fbe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0fb7 expref: 20 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309578:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0fbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0fb7 expref: 20 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309587:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725932.309607:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+20:3304:x1875614935052544:12345-0@lo:103: Request processed in 49us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.309612:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788725932.309624:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788725932.309629:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935052160:12345-0@lo:103: 00010000:00010000:3.0:1788725932.309636:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725932.309640:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10e725400/0xcbde9110e47c1004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0ffd expref: 19 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309654:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10e725400/0xcbde9110e47c1004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0ffd expref: 19 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309663:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e725400/0xcbde9110e47c1004 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0ffd expref: 19 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309672:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725932.309698:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:3306:x1875614935052160:12345-0@lo:103: Request processed in 69us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.309704:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788725932.309717:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788725932.309723:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:3306:x1875614935052672:12345-0@lo:103: 00010000:00010000:3.0:1788725932.309730:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725932.309734:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f94 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0f8d expref: 17 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309742:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0f8d expref: 17 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309751:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725932.309771:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:3306:x1875614935052672:12345-0@lo:103: Request processed in 49us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.309777:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788725932.309788:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788725932.309793:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:3306:x1875614935052288:12345-0@lo:103: 00010000:00010000:3.0:1788725932.309800:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725932.309804:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10e725c00/0xcbde9110e47c0ff6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0fef expref: 16 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309817:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10e725c00/0xcbde9110e47c0ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0fef expref: 16 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309827:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e725c00/0xcbde9110e47c0ff6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0fef expref: 16 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.309836:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725932.309857:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:3306:x1875614935052288:12345-0@lo:103: Request processed in 64us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.309862:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788725932.309903:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935052288:0@lo:103: 00000100:00100000:3.0:1788725932.309911:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935052160:0@lo:103: 00000100:00100000:3.0:1788725932.309917:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935052672:0@lo:103: 00000100:00100000:3.0:1788725932.309945:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935052032:0@lo:103: 00000100:00100000:3.0:1788725932.309952:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935052544:0@lo:103: 00000100:00100000:3.0:1788725932.309958:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935051904:0@lo:103: 00000100:00100000:3.0:1788725932.309965:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935052416:0@lo:103: 00010000:00010000:0.0:1788725932.314723:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e724400/0xcbde9110e47c0fe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0fe1 expref: 14 pid: 5828 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725932.314762:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935051520:0@lo:104: 00010000:00010000:0.0:1788725932.314796:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10db70000/0xcbde9110e47c0fbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0fb7 expref: 13 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725932.314807:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935051648:0@lo:104: 00010000:00010000:0.0:1788725932.314817:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100031000/0xcbde9110e47c0f94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0f8d expref: 12 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725932.314825:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111615f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935051776:0@lo:104: 00000100:00100000:0.0:1788725932.320691:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725932.320780:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914056704 00000100:00100000:3.0:1788725932.320792:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914056704 00010000:00010000:3.0:1788725932.320838:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c105f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559e97 expref: 10 pid: 5829 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725932.320893:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:3.0:1788725932.320904:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1202a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2306ca11-4668-43b2-bddf-879669734d27+10:2349:x1875614914056704:12345-192.168.201.42@tcp:103: 00010000:00010000:3.0:1788725932.320931:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725932.320938:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c105f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559e97 expref: 10 pid: 5829 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.320950:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c105f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559e97 expref: 10 pid: 5829 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725932.320969:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725932.321032:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1202a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2306ca11-4668-43b2-bddf-879669734d27+10:2349:x1875614914056704:12345-192.168.201.42@tcp:103: Request processed in 130us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725932.321039:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00010000:00010000:1.0:1788725932.321659:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c105f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559e97 expref: 9 pid: 5829 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725932.321675:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139867100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935050752:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788725932.321687:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139867800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875614935050880:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788725932.321730:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c1097 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725932.337121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725932.337339:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914056832 00000100:00100000:2.0:1788725932.337352:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914056832 00010000:00010000:2.0:1788725932.337391:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a100030400/0xcbde9110e47c1058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559e90 expref: 9 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725932.337482:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:2.0:1788725932.337493:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2306ca11-4668-43b2-bddf-879669734d27+9:2350:x1875614914056832:12345-192.168.201.42@tcp:103: 00010000:00010000:2.0:1788725932.337508:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725932.337515:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a100030400/0xcbde9110e47c1058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559e90 expref: 9 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725932.337527:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a100030400/0xcbde9110e47c1058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559e90 expref: 9 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725932.337541:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100030400/0xcbde9110e47c1058 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559e90 expref: 9 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725932.337557:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c1097 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725932.337563:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c1097 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725932.337576:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c1097 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725932.337580:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c1097 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725932.337585:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c1097 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725932.337604:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c1097 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725932.337609:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ebe00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788725932.337612:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c1097 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725932.337628:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c1097 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725932.337643:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c1097 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725932.337653:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788725932.337787:0:8433:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c1097 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.337796:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c1097 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725932.337802:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c1097 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725932.339836:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2306ca11-4668-43b2-bddf-879669734d27+8:2350:x1875614914056832:12345-192.168.201.42@tcp:103: Request processed in 2330us (2711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725932.339852:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:0.0:1788725932.757463:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788725932.758964:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935052800:0@lo:13: 00000100:00100000:0.0:1788725932.759465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725932.764235:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935052800 00000100:00100000:2.0:1788725932.764251:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935052800 00000100:00100000:2.0:1788725932.764451:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788725932.764952:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935052800:12345-0@lo:13: 00002000:00000024:2.0:1788725932.764991:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788725932.765183:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935052800:12345-0@lo:13: Request processed in 723us (5718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725932.765189:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788725932.765261:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a005963800 x1875614935052800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725932.765278:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935052800:0@lo:13: 00010000:00010000:3.0:1788725933.079323:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725933.477373:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725933.477704:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914056960 00000100:00100000:0.0:1788725933.477714:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914056960 00000100:00100000:0.0:1788725933.477772:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:0.0:1788725933.477782:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+8:5593:x1875614914056960:12345-192.168.201.42@tcp:101: 00010000:00010000:0.0:1788725933.477799:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725933.477819:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a100031a00/0xcbde9110e47c109e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be90559ef9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.477844:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a100031a00/0xcbde9110e47c109e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ef9 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.477871:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a100031a00/0xcbde9110e47c109e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ef9 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.477881:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100031a00, rc 0) 00000100:00100000:0.0:1788725933.477943:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+9:5593:x1875614914056960:12345-192.168.201.42@tcp:101: Request processed in 162us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725933.477949:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:0.0:1788725933.487512:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725933.487629:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914057088 00000100:00100000:1.0:1788725933.487639:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914057088 00000100:00100000:1.0:1788725933.487706:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:1.0:1788725933.487718:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+9:5593:x1875614914057088:12345-192.168.201.42@tcp:501: 00000100:00100000:1.0:1788725933.488032:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+9:5593:x1875614914057088:12345-192.168.201.42@tcp:501: Request processed in 315us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725933.488041:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:3.0:1788725933.495937:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725933.496045:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914057216 00000100:00100000:1.0:1788725933.496055:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914057216 00000100:00100000:1.0:1788725933.496117:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:1.0:1788725933.496127:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+9:5593:x1875614914057216:12345-192.168.201.42@tcp:503: 00000100:00100000:1.0:1788725933.496396:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+9:5593:x1875614914057216:12345-192.168.201.42@tcp:503: Request processed in 259us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725933.496404:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:3.0:1788725933.498973:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725933.499170:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914057344 00000100:00100000:0.0:1788725933.499181:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914057344 00000100:00100000:0.0:1788725933.499262:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:0.0:1788725933.499273:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+9:6060:x1875614914057344:12345-192.168.201.42@tcp:502: 00000100:00100000:0.0:1788725933.499571:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+9:6060:x1875614914057344:12345-192.168.201.42@tcp:502: Request processed in 298us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725933.499579:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:0.0:1788725933.507456:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725933.507760:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914057472 00000100:00100000:3.0:1788725933.507771:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914057472 00000100:00100000:3.0:1788725933.507832:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:3.0:1788725933.507844:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+9:6060:x1875614914057472:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788725933.508140:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+9:6060:x1875614914057472:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 297us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725933.508157:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:3.0:1788725933.512314:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725933.513654:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914057600 00000100:00100000:2.0:1788725933.513667:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914057600 00000100:00100000:2.0:1788725933.513794:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:2.0:1788725933.513805:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+9:5593:x1875614914057600:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725933.513821:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725933.513837:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e725c00/0xcbde9110e47c10a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be90559f00 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725933.513862:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e725c00/0xcbde9110e47c10a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f00 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725933.513870:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e725c00/0xcbde9110e47c10a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f00 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725933.513877:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725c00, rc 0) 00000100:00100000:2.0:1788725933.513935:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:5593:x1875614914057600:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 Request processed in 132us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725933.513942:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:0.0:1788725933.520278:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725933.520421:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914057728 00000100:00100000:1.0:1788725933.520432:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914057728 00000100:00100000:1.0:1788725933.520489:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:1.0:1788725933.520500:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:5593:x1875614914057728:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725933.520792:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:5593:x1875614914057728:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 Request processed in 292us (524us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788725933.520802:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:2.0:1788725933.783810:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725933.783840:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935052928:0@lo:13: 00000100:00100000:2.0:1788725933.783914:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725933.784091:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935052928 00000100:00100000:3.0:1788725933.784100:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935052928 00000100:00100000:3.0:1788725933.784155:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788725933.784165:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935052928:12345-0@lo:13: 00002000:00000024:3.0:1788725933.784209:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788725933.784281:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935052928:12345-0@lo:13: Request processed in 117us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725933.784288:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788725933.784365:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1089b2680 x1875614935052928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725933.784399:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935052928:0@lo:13: 00010000:00010000:3.0:1788725934.102312:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788725934.297122:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788725934.297130:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91a13adc2000 from 39 10000000:01000000:2.0:1788725934.297137:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788725934.297200:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.297250:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.297263:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725934.297293:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935053056:0@lo:101: 00000100:00100000:2.0:1788725934.297385:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725934.297443:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1095a3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788725934.297861:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935053056 00000100:00100000:3.0:1788725934.297870:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935053056 00000100:00100000:3.0:1788725934.297934:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788725934.297945:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+12:5831:x1875614935053056:12345-0@lo:101: 00010000:00010000:3.0:1788725934.297960:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725934.297976:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10db71400/0xcbde9110e47c10b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c10ac expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.297998:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10db71400/0xcbde9110e47c10b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c10ac expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.298008:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10db71400/0xcbde9110e47c10b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c10ac expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.298017:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10db71400, rc 0) 00000100:00100000:3.0:1788725934.298062:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:5831:x1875614935053056:12345-0@lo:101: Request processed in 120us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725934.298069:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788725934.298075:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005963100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935053056:0@lo:101: 00010000:00010000:2.0:1788725934.298091:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.298100:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c10b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725934.298209:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935053184:0@lo:501: 00000100:00100000:3.0:1788725934.298261:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725934.298280:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a112eb6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788725934.298412:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935053184 00000100:00100000:2.0:1788725934.298417:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935053184 00000100:00100000:2.0:1788725934.298449:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788725934.298457:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:5831:x1875614935053184:12345-0@lo:501: 00000100:00100000:3.0:1788725934.299176:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935053184:0@lo:501: 00000100:00100000:3.0:1788725934.299209:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935053312:0@lo:503: 00000100:00100000:3.0:1788725934.302944:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725934.303077:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935053312 00000100:00100000:0.0:1788725934.303088:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935053312 00000100:00100000:0.0:1788725934.303145:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788725934.303156:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:5831:x1875614935053312:12345-0@lo:503: 00000100:00100000:3.0:1788725934.303423:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a112eb6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788725934.305244:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:5831:x1875614935053184:12345-0@lo:501: Request processed in 6777us (6971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725934.305260:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788725934.306137:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:5831:x1875614935053312:12345-0@lo:503: Request processed in 2978us (3196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725934.306149:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788725934.306275:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935053312:0@lo:503: 00000100:00100000:1.0:1788725934.307119:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111615f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8465:1875614935053440:0@lo:502: 00000100:00100000:1.0:1788725934.307192:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725934.307262:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a110e9ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725934.307349:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935053440 00000100:00100000:0.0:1788725934.307362:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935053440 00000100:00100000:0.0:1788725934.307447:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788725934.307457:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:8465:x1875614935053440:12345-0@lo:502: 00000100:00100000:0.0:1788725934.307740:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:8465:x1875614935053440:12345-0@lo:502: Request processed in 284us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725934.307747:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788725934.310464:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111615f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8465:1875614935053440:0@lo:502: 00000100:00100000:1.0:1788725934.310541:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111615f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8465:1875614935053568:0@lo:502: 00000100:00100000:1.0:1788725934.310625:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725934.311085:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a110e9ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725934.311268:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935053568 00000100:00100000:2.0:1788725934.311279:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935053568 00000100:00100000:2.0:1788725934.311488:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788725934.311498:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:8465:x1875614935053568:12345-0@lo:502: 00000100:00100000:2.0:1788725934.312190:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:8465:x1875614935053568:12345-0@lo:502: Request processed in 691us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725934.312199:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788725934.316148:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111615f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8465:1875614935053568:0@lo:502: 00000040:00080000:1.0:1788725934.316196:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788725934.318285:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788725934.318325:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788725934.318339:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.318353:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725934.318363:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788725934.318366:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788725934.318369:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788725934.318417:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.318425:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.318436:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725934.318461:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935053696:0@lo:101: 00000100:00100000:3.0:1788725934.318528:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725934.318569:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a112949900 going to sleep for 11 seconds 00000100:00100000:3.0:1788725934.318602:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935053696 00000100:00100000:3.0:1788725934.318609:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935053696 00000100:00100000:3.0:1788725934.318657:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788725934.318667:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+13:5831:x1875614935053696:12345-0@lo:101: 00010000:00010000:3.0:1788725934.318881:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725934.318904:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10db71200/0xcbde9110e47c10c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c10ba expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.318927:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10db71200/0xcbde9110e47c10c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c10ba expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.318937:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10db71200/0xcbde9110e47c10c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c10ba expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.318945:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10db71200, rc 0) 00000100:00100000:3.0:1788725934.319055:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:5831:x1875614935053696:12345-0@lo:101: Request processed in 389us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725934.319063:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788725934.319110:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935053696:0@lo:101: 00010000:00010000:3.0:1788725934.319124:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.319133:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c10c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725934.319176:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935053824:0@lo:501: 00000100:00100000:3.0:1788725934.319201:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725934.319244:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935053824 00000100:00100000:3.0:1788725934.319248:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935053824 00000100:00100000:3.0:1788725934.319268:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788725934.319274:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:5831:x1875614935053824:12345-0@lo:501: 00000100:00100000:3.0:1788725934.319519:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:5831:x1875614935053824:12345-0@lo:501: Request processed in 244us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725934.319525:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788725934.319558:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a112949900 going to sleep for 11 seconds 00000100:00100000:3.0:1788725934.319569:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935053824:0@lo:501: 00000100:00100000:3.0:1788725934.319608:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935053952:0@lo:503: 00000100:00100000:3.0:1788725934.319646:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725934.319659:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12004e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788725934.319671:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935053952 00000100:00100000:3.0:1788725934.319674:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935053952 00000100:00100000:3.0:1788725934.321940:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788725934.321956:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:5831:x1875614935053952:12345-0@lo:503: 00000100:00100000:3.0:1788725934.322357:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:5831:x1875614935053952:12345-0@lo:503: Request processed in 405us (2709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725934.322366:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788725934.322446:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935053952:0@lo:503: 00000100:00100000:1.0:1788725934.330395:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111615f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8467:1875614935054080:0@lo:502: 00000100:00100000:1.0:1788725934.330488:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725934.330531:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a110e9e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788725934.334966:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935054080 00000100:00100000:3.0:1788725934.334993:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935054080 00000100:00100000:3.0:1788725934.335057:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788725934.335068:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:8467:x1875614935054080:12345-0@lo:502: 00000100:00100000:3.0:1788725934.335369:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:8467:x1875614935054080:12345-0@lo:502: Request processed in 302us (4880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725934.335390:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788725934.335575:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111615f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8467:1875614935054080:0@lo:502: 00000020:01000000:1.0:1788725934.335622:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788725934.335631:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725934.335634:0:8467:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788725934.335640:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788725934.335675:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111615f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8467:1875614935054208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725934.335721:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725934.335762:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a110e9e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788725934.335951:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935054208 00000100:00100000:2.0:1788725934.335957:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935054208 00000100:00100000:2.0:1788725934.336007:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788725934.336020:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:8467:x1875614935054208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725934.336182:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:8467:x1875614935054208:12345-0@lo:502:llog_process_th.0 Request processed in 168us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725934.336190:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788725934.336405:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111615f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8467:1875614935054208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788725934.336427:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725934.336432:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725934.336434:0:8467:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788725934.336438:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788725934.337767:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788725934.338907:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788725934.338924:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.338937:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725934.338968:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788725934.338971:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91a10338f800 from 39 10000000:01000000:3.0:1788725934.338974:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788725934.339132:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.339141:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.339152:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725934.339180:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935054336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788725934.339439:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725934.339482:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748240 going to sleep for 11 seconds 00000100:00100000:2.0:1788725934.339703:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935054336 00000100:00100000:2.0:1788725934.339712:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935054336 00000100:00100000:2.0:1788725934.339814:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788725934.339824:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:5831:x1875614935054336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725934.339838:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725934.339850:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e725800/0xcbde9110e47c10cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c10c8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.339874:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e725800/0xcbde9110e47c10cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c10c8 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.339884:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e725800/0xcbde9110e47c10cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c10c8 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.339891:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725800, rc 0) 00000100:00100000:2.0:1788725934.339943:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:5831:x1875614935054336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725934.339950:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788725934.341052:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935054336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725934.341074:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.341085:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c10cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725934.341154:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935054464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725934.341197:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725934.351435:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935054464 00000100:00100000:1.0:1788725934.351454:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935054464 00000100:00100000:1.0:1788725934.353424:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788725934.353438:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:5831:x1875614935054464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725934.355466:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:5831:x1875614935054464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2024us (14260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725934.355481:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788725934.356525:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748240 going to sleep for 11 seconds 00000100:00100000:3.0:1788725934.356561:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935054464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725934.357688:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935054592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788725934.358312:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725934.358354:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748240 going to sleep for 11 seconds 00000100:00100000:2.0:1788725934.358977:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935054592 00000100:00100000:2.0:1788725934.359063:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935054592 00000100:00100000:2.0:1788725934.359128:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788725934.359140:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:5831:x1875614935054592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725934.359392:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:5831:x1875614935054592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 254us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725934.359401:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788725934.360241:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935054592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788725934.367503:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8468:1875614935054720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725934.367612:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725934.367665:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935054720 00000100:00100000:3.0:1788725934.367674:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935054720 00000100:00100000:3.0:1788725934.367738:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788725934.367748:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:8468:x1875614935054720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725934.369288:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748000 going to sleep for 11 seconds 00000100:00100000:3.0:1788725934.369453:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:8468:x1875614935054720:12345-0@lo:502:llog_process_th.0 Request processed in 1702us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725934.369463:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788725934.369839:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8468:1875614935054720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725934.369907:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005963100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8468:1875614935054848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725934.369957:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725934.369990:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1202673c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725934.370281:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935054848 00000100:00100000:0.0:1788725934.370288:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935054848 00000100:00100000:0.0:1788725934.370327:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788725934.370335:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:8468:x1875614935054848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725934.370560:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:8468:x1875614935054848:12345-0@lo:502:llog_process_th.0 Request processed in 225us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725934.370566:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788725934.371139:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005963100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8468:1875614935054848:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788725934.371170:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788725934.375112:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788725934.375147:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788725934.375158:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.375170:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725934.375180:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788725934.375183:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788725934.375186:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788725934.375247:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.375255:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.375279:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725934.375305:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935054976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788725934.375399:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725934.375442:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a102aa1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788725934.375466:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935054976 00000100:00100000:2.0:1788725934.375473:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935054976 00000100:00100000:2.0:1788725934.375519:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788725934.375529:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:5831:x1875614935054976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725934.375542:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725934.375554:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e724e00/0xcbde9110e47c10dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c10d6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.375576:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e724e00/0xcbde9110e47c10dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c10d6 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.375585:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e724e00/0xcbde9110e47c10dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c10d6 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.375595:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724e00, rc 0) 00000100:00100000:2.0:1788725934.375632:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935054976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725934.375639:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788725934.375683:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935054976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725934.375697:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.375713:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c10dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725934.375777:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935055104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725934.375997:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725934.376019:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1088c5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788725934.376032:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935055104 00000100:00100000:2.0:1788725934.376036:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935055104 00000100:00100000:2.0:1788725934.376059:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788725934.376065:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935055104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725934.376325:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935055104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725934.376332:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788725934.376360:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935055104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725934.376399:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935055232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725934.376435:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725934.376448:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1088c5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788725934.376459:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935055232 00000100:00100000:2.0:1788725934.376462:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935055232 00000100:00100000:2.0:1788725934.376479:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788725934.376484:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935055232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725934.376622:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935055232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725934.376628:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788725934.376666:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935055232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725934.384876:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8470:1875614935055360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725934.384969:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725934.385095:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935055360 00000100:00100000:2.0:1788725934.385103:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935055360 00000100:00100000:2.0:1788725934.385201:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788725934.385212:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:8470:x1875614935055360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725934.385468:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:8470:x1875614935055360:12345-0@lo:502:llog_process_th.0 Request processed in 258us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725934.385477:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788725934.389663:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1117950c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725934.389704:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8470:1875614935055360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788725934.389750:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788725934.389763:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725934.389765:0:8470:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788725934.389771:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788725934.389824:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8470:1875614935055488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725934.389894:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725934.397348:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1117950c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725934.401341:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935055488 00000100:00100000:1.0:1788725934.401357:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935055488 00000100:00100000:1.0:1788725934.401439:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788725934.401449:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:8470:x1875614935055488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725934.401983:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:8470:x1875614935055488:12345-0@lo:502:llog_process_th.0 Request processed in 532us (12086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725934.401993:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788725934.402095:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8470:1875614935055488:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788725934.402129:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725934.402142:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725934.402144:0:8470:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788725934.402149:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788725934.403288:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788725934.403315:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788725934.403327:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.403340:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725934.403351:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788725934.403353:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91a120292000 from 39 10000000:01000000:0.0:1788725934.403356:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788725934.403402:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.403411:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.403422:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725934.403446:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935055616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788725934.403501:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725934.403550:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1117950c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725934.403626:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935055616 00000100:00100000:1.0:1788725934.403632:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935055616 00000100:00100000:1.0:1788725934.403667:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788725934.403676:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935055616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788725934.403688:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725934.403700:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a1398eb400/0xcbde9110e47c10eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c10e4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725934.403724:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398eb400/0xcbde9110e47c10eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c10e4 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725934.403734:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a1398eb400/0xcbde9110e47c10eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c10e4 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725934.403742:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eb400, rc 0) 00000100:00100000:1.0:1788725934.403789:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935055616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725934.403809:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788725934.403898:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935055616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788725934.403911:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10eb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.403931:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c10eb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725934.403992:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935055744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725934.404018:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725934.404041:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1117950c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725934.404058:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935055744 00000100:00100000:1.0:1788725934.404063:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935055744 00000100:00100000:1.0:1788725934.404080:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788725934.404085:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935055744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725934.404347:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935055744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725934.404354:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788725934.404396:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935055744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725934.404423:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935055872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725934.404459:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725934.404486:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1117950c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725934.406707:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935055872 00000100:00100000:1.0:1788725934.406721:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935055872 00000100:00100000:1.0:1788725934.406772:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788725934.406781:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935055872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725934.407029:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935055872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 249us (2569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725934.407037:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788725934.407087:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935055872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725934.407557:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8471:1875614935056000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725934.407615:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725934.407644:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111795480 going to sleep for 11 seconds 00000100:00100000:0.0:1788725934.408286:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935056000 00000100:00100000:0.0:1788725934.408294:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935056000 00000100:00100000:0.0:1788725934.408327:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788725934.408335:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:8471:x1875614935056000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725934.408582:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:8471:x1875614935056000:12345-0@lo:502:llog_process_th.0 Request processed in 247us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725934.408600:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788725934.408931:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8471:1875614935056000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725934.409004:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8471:1875614935056128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725934.409045:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725934.409070:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1088c5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788725934.409176:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935056128 00000100:00100000:0.0:1788725934.409181:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935056128 00000100:00100000:0.0:1788725934.409203:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788725934.409242:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:8471:x1875614935056128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725934.409433:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:8471:x1875614935056128:12345-0@lo:502:llog_process_th.0 Request processed in 216us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725934.409441:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788725934.409602:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8471:1875614935056128:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788725934.409624:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788725934.410693:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788725934.410732:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788725934.410744:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10eb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.410756:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10eb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725934.410766:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788725934.410769:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788725934.410772:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788725934.410975:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.411061:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.411072:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725934.411095:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935056256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788725934.411147:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725934.411188:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111795840 going to sleep for 11 seconds 00000100:00100000:2.0:1788725934.411337:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935056256 00000100:00100000:2.0:1788725934.411345:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935056256 00000100:00100000:2.0:1788725934.411399:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788725934.411408:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935056256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725934.411420:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725934.411431:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e724a00/0xcbde9110e47c10f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c10f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.411452:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e724a00/0xcbde9110e47c10f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c10f2 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.411462:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e724a00/0xcbde9110e47c10f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c10f2 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.411481:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724a00, rc 0) 00000100:00100000:2.0:1788725934.411525:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935056256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725934.411531:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788725934.411674:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935056256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788725934.412052:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.412062:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c10f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725934.412114:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935056384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725934.412141:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725934.412171:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111795840 going to sleep for 11 seconds 00000100:00100000:2.0:1788725934.412389:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935056384 00000100:00100000:2.0:1788725934.412395:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935056384 00000100:00100000:2.0:1788725934.412429:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788725934.412436:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935056384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725934.412736:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935056384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725934.412744:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788725934.413327:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935056384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725934.413363:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935056512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725934.413415:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725934.413437:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111795840 going to sleep for 11 seconds 00000100:00100000:3.0:1788725934.413561:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935056512 00000100:00100000:3.0:1788725934.413567:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935056512 00000100:00100000:0.0:1788725934.414153:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788725934.414162:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935056512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725934.414384:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935056512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725934.414391:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788725934.416510:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935056512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725934.416992:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111615f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8472:1875614935056640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725934.417068:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725934.417113:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a112eb6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788725934.417164:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935056640 00000100:00100000:0.0:1788725934.417172:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935056640 00000100:00100000:2.0:1788725934.417255:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788725934.417267:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:8472:x1875614935056640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725934.417563:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:8472:x1875614935056640:12345-0@lo:502:llog_process_th.0 Request processed in 299us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725934.424850:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111615f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8472:1875614935056640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788725934.425061:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725934.425078:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725934.425081:0:8472:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788725934.425088:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788725934.425133:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8472:1875614935056768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725934.425243:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725934.425276:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935056768 00000100:00100000:3.0:1788725934.425282:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748240 going to sleep for 11 seconds 00000100:00100000:0.0:1788725934.425284:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935056768 00000100:00100000:0.0:1788725934.425328:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788725934.425338:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:8472:x1875614935056768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725934.425703:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8472:1875614935056768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725934.425703:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:8472:x1875614935056768:12345-0@lo:502:llog_process_th.0 Request processed in 367us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725934.425721:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000020:01000000:3.0:1788725934.425737:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788725934.425745:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725934.425747:0:8472:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788725934.425751:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788725934.425847:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788725934.425941:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788725934.425953:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.425965:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725934.425976:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788725934.425980:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91a103273370 from 1 10000000:01000000:0.0:1788725934.425983:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788725934.426010:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c1100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.426018:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c1100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.426026:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c1100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725934.426040:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935056896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788725934.426077:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725934.426106:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111795240 going to sleep for 11 seconds 00000100:00100000:3.0:1788725934.426191:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935056896 00000100:00100000:3.0:1788725934.426196:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935056896 00000100:00100000:3.0:1788725934.426251:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788725934.426259:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935056896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725934.426269:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725934.426281:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10db70000/0xcbde9110e47c1107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c1100 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.426303:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10db70000/0xcbde9110e47c1107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c1100 expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.426312:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10db70000/0xcbde9110e47c1107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c1100 expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.426321:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10db70000, rc 0) 00000100:00100000:3.0:1788725934.426353:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+20:5831:x1875614935056896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725934.426359:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788725934.426401:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788725934.426439:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935056896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788725934.426450:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c1100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1107 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.426468:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c1100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c1107 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725934.426601:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935057024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725934.426703:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725934.426732:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111795240 going to sleep for 11 seconds 00000100:00100000:1.0:1788725934.426769:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935057024 00000100:00100000:1.0:1788725934.426774:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935057024 00000100:00100000:1.0:1788725934.426810:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788725934.426817:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935057024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725934.427058:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935057024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (354us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788725934.427065:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788725934.427678:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935057024:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788725934.427715:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788725934.427722:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c1100 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1107 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.427731:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c1100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1107 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788725934.661591:0:8491:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf9b0e580 20000000:00000080:2.0:1788725934.661621:0:8491:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91a13a4c3000 uarg=0000000000000000 20000000:01000000:2.0:1788725934.661661:0:8491:0:(mgs_llog.c:6195:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788725934.661667:0:8491:0:(mgs_llog.c:4650:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788725934.661672:0:8491:0:(mgs_llog.c:1382:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788725934.663997:0:8492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788725934.664287:0:8491:0:(mgs_llog.c:4123:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788725934.672066:0:8491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788725934.672120:0:8491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788725934.672179:0:8491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788725934.672197:0:8491:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788725934.672239:0:8491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c110e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.672259:0:8491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a100030a00/0xcbde9110e47c0e91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0e8a expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.672281:0:8491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c0f24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0f1d expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.672287:0:8491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a100030200/0xcbde9110e47c0fb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c0fa9 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.672296:0:8491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c106d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ec8 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.672304:0:8491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c110e lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.672344:0:8491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c106d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ec8 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.672359:0:8491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c106d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ec8 expref: 9 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725934.672387:0:8491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875614935057152:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788725934.672501:0:8491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a100030200/0xcbde9110e47c0fb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0fa9 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.672510:0:8491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a100030200/0xcbde9110e47c0fb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0fa9 expref: 18 pid: 5827 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725934.672520:0:8491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875614935057280:0@lo:104: 00000100:00100000:3.0:1788725934.672561:0:8491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788725934.672606:0:8491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c0f24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0f1d expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.672620:0:8491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c0f24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0f1d expref: 18 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725934.672628:0:8491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875614935057408:0@lo:104: 00010000:00010000:3.0:1788725934.672654:0:8491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a100030a00/0xcbde9110e47c0e91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c0e8a expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.672661:0:8491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a100030a00/0xcbde9110e47c0e91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c0e8a expref: 18 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725934.672668:0:8491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875614935057536:0@lo:104: 00000100:00100000:3.0:1788725934.672684:0:8491:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748600 going to sleep for 11 seconds 00000100:00100000:1.0:1788725934.672915:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788725934.672934:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725934.673118:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725934.673282:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935057280 00000100:00100000:3.0:1788725934.673291:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935057280 00000100:00100000:3.0:1788725934.673329:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935057408 00000100:00100000:3.0:1788725934.673332:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935057408 00000100:00100000:3.0:1788725934.673356:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935057536 00000100:00100000:3.0:1788725934.673359:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935057536 00000100:00100000:3.0:1788725934.673383:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788725934.673392:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a004b7c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+5:8491:x1875614935057280:12345-0@lo:104: 00010000:00010000:3.0:1788725934.673404:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10db71a00/0xcbde9110e47c0fa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0fb0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.673469:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788725934.673475:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a004b7c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+5:8491:x1875614935057280:12345-0@lo:104: Request processed in 85us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725934.673482:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788725934.673519:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788725934.673533:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111615f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+4:8491:x1875614935057408:12345-0@lo:104: 00010000:00010000:3.0:1788725934.673540:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10149a200/0xcbde9110e47c0f1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0f24 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.673578:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788725934.673583:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111615f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+4:8491:x1875614935057408:12345-0@lo:104: Request processed in 52us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725934.673589:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788725934.673602:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788725934.673607:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:8491:x1875614935057536:12345-0@lo:104: 00010000:00010000:3.0:1788725934.673614:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10db71c00/0xcbde9110e47c0e8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0e91 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.673640:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788725934.673645:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:8491:x1875614935057536:12345-0@lo:104: Request processed in 38us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725934.673651:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1788725934.673666:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788725934.673671:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10db71a00/0xcbde9110e47c0fa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0fb0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.673691:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10db71a00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:3.0:1788725934.673695:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10db71a00/0xcbde9110e47c0fa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0fb0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.673703:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10db71a00/0xcbde9110e47c0fa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0fb0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725934.673709:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10db71a00/0xcbde9110e47c0fa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0fb0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725934.673957:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788725934.674482:0:8491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875614935057280:0@lo:104: 00000100:00100000:0.0:1788725934.674493:0:8491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875614935057408:0@lo:104: 00000100:00100000:0.0:1788725934.674499:0:8491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875614935057536:0@lo:104: 00010000:00010000:2.0:1788725934.674560:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788725934.675029:0:8493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788725934.675108:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10149a200/0xcbde9110e47c0f1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0f24 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.675118:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149a200 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788725934.675122:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10149a200/0xcbde9110e47c0f1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0f24 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.675130:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10149a200/0xcbde9110e47c0f1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0f24 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725934.675146:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10149a200/0xcbde9110e47c0f1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0f24 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725934.675152:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788725934.675191:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10149a200/0xcbde9110e47c0f1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0f24 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.675198:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725934.675203:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10db71a00/0xcbde9110e47c0fa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0fb0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.675209:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725934.675238:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10db71a00/0xcbde9110e47c0fa9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0fb0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.675238:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10149a200/0xcbde9110e47c0f1d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0f24 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.675247:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10db71a00/0xcbde9110e47c0fa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0fb0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.675247:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10149a200/0xcbde9110e47c0f1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0f24 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.675261:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725934.675262:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725934.675263:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725934.675263:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725934.675264:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725934.675265:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725934.675277:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935057792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788725934.675280:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725934.675288:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935057664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788725934.676583:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725934.676645:0:8493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10db71c00/0xcbde9110e47c0e8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c0e91 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.676665:0:8493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10db71c00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:2.0:1788725934.676669:0:8493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10db71c00/0xcbde9110e47c0e8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c0e91 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.676677:0:8493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10db71c00/0xcbde9110e47c0e8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c0e91 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725934.676683:0:8493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10db71c00/0xcbde9110e47c0e8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c0e91 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725934.676688:0:8493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788725934.676733:0:8493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10db71c00/0xcbde9110e47c0e8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0e91 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.676739:0:8493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725934.676751:0:8493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10db71c00/0xcbde9110e47c0e8a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0e91 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.676757:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10db71c00/0xcbde9110e47c0e8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c0e91 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.676770:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725934.676772:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725934.676774:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725934.676778:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725934.676780:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725934.678263:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725934.678337:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725934.678350:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935057920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788725934.678401:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725934.678409:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935057792 00000100:00100000:2.0:1788725934.678417:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935057792 00000100:00100000:3.0:1788725934.678430:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935057920 00000100:00100000:3.0:1788725934.678432:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935057920 00010000:00010000:3.0:1788725934.678449:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a100030a00/0xcbde9110e47c0e91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0e8a expref: 20 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.678449:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a100030200/0xcbde9110e47c0fb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0fa9 expref: 20 pid: 5827 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725934.678478:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788725934.678487:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+20:3306:x1875614935057920:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788725934.678494:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788725934.678499:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+20:3306:x1875614935057792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788725934.678501:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725934.678506:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725934.678507:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a100030a00/0xcbde9110e47c0e91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0e8a expref: 20 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.678509:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a100030200/0xcbde9110e47c0fb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0fa9 expref: 20 pid: 5827 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.678517:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a100030a00/0xcbde9110e47c0e91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0e8a expref: 20 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.678526:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a100030200/0xcbde9110e47c0fb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0fa9 expref: 20 pid: 5827 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725934.678601:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725934.682782:0:8491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875614935057152:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788725934.684827:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:3.0:1788725934.686621:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100030200/0xcbde9110e47c0fb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0fa9 expref: 20 pid: 5827 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.686621:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100030a00/0xcbde9110e47c0e91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0e8a expref: 20 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.686649:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788725934.686650:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788725934.686859:0:8491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c110e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725934.688375:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788725934.688391:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788725934.688530:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935057664 00000100:00100000:0.0:1788725934.688539:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935057664 00010000:00010000:0.0:1788725934.688588:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c0f24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0f1d expref: 19 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725934.688620:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788725934.688630:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914057856 00000100:00100000:0.0:1788725934.688639:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914057856 00010000:00010000:0.0:1788725934.688655:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c106d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ec8 expref: 10 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725934.688738:0:8495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788725934.688743:0:8495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1788725934.689110:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788725934.689124:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935057664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788725934.689140:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725934.689147:0:8495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c0f24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c0f1d expref: 19 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725934.689158:0:8495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c0f24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c0f1d expref: 19 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725934.689173:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c0f24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c0f1d expref: 19 pid: 5829 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725934.689184:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725934.689294:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:0.0:1788725934.689317:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2306ca11-4668-43b2-bddf-879669734d27+10:2350:x1875614914057856:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725934.689326:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725934.689331:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c106d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ec8 expref: 10 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.689340:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c106d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ec8 expref: 10 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.689350:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c106d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ec8 expref: 10 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.689361:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c110e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.689380:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c110e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.689393:0:8496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c110e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.689401:0:8496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c110e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.689407:0:8496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c110e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.689421:0:8496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c110e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.689427:0:8496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10db70a00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:0.0:1788725934.689431:0:8496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c110e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.689440:0:8496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c110e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.689455:0:8496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c110e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725934.689466:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725934.689950:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:3306:x1875614935057920:12345-0@lo:103:ldlm_bl.0 Request processed in 11461us (11545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725934.689961:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788725934.690397:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935057920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788725934.692421:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:3306:x1875614935057792:12345-0@lo:103:ldlm_bl.0 Request processed in 13913us (14155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725934.692435:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788725934.692468:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935057792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788725934.692659:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:3304:x1875614935057664:12345-0@lo:103:ldlm_bl.0 Request processed in 3538us (14056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725934.692667:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788725934.692699:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935057664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788725934.693284:0:8491:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c110e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.693298:0:8491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c110e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725934.693305:0:8491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10db70a00/0xcbde9110e47c110e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725934.701928:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2306ca11-4668-43b2-bddf-879669734d27+9:2350:x1875614914057856:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 12612us (17096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725934.701947:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:0.0:1788725934.984843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725934.985499:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914057984 00000100:00100000:3.0:1788725934.985510:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914057984 00000100:00100000:3.0:1788725934.985571:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 172 00000100:00100000:3.0:1788725934.985581:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+9:5593:x1875614914057984:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725934.985596:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725934.985615:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10db71a00/0xcbde9110e47c1115 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be90559f07 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.985641:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10db71a00/0xcbde9110e47c1115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f07 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.985652:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10db71a00/0xcbde9110e47c1115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f07 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725934.985661:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10db71a00, rc 0) 00000100:00100000:3.0:1788725934.985710:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:5593:x1875614914057984:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 Request processed in 130us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725934.985718:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 172 00000100:00100000:2.0:1788725934.997565:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725934.997870:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914058112 00000100:00100000:3.0:1788725934.997881:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914058112 00000100:00100000:3.0:1788725934.997961:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 173 00000100:00100000:3.0:1788725934.997972:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:5593:x1875614914058112:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725934.998851:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:5593:x1875614914058112:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 Request processed in 877us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725934.998861:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 173 00000100:00100000:2.0:1788725935.012869:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725935.012953:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914058240 00000100:00100000:0.0:1788725935.012963:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914058240 00000100:00100000:0.0:1788725935.013025:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 174 00000100:00100000:0.0:1788725935.013036:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+10:5593:x1875614914058240:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725935.013489:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+10:5593:x1875614914058240:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 Request processed in 453us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725935.013498:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 174 00000100:00100000:3.0:1788725935.018097:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725935.018818:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914058368 00000100:00100000:2.0:1788725935.018829:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914058368 00000100:00100000:2.0:1788725935.018888:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 175 00000100:00100000:2.0:1788725935.018900:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:6101:x1875614914058368:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788725935.019166:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:6101:x1875614914058368:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 267us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725935.019175:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 175 00000100:00100000:2.0:1788725935.022465:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725935.023534:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914058496 00000100:00100000:0.0:1788725935.023548:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914058496 00000100:00100000:1.0:1788725935.028983:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 176 00000100:00100000:1.0:1788725935.028999:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+10:6101:x1875614914058496:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788725935.029299:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+10:6101:x1875614914058496:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 302us (6842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725935.029314:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 176 00010000:00010000:3.0:1788725935.125405:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788725935.829684:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788725935.829694:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a13adc2000 from 4 10000000:01000000:2.0:1788725935.829700:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788725935.829765:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724c00/0xcbde9110e47c111c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.829779:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10e724c00/0xcbde9110e47c111c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.829791:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e724c00/0xcbde9110e47c111c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725935.829819:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935058048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788725935.829896:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725935.829979:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a005881b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788725935.830205:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935058048 00000100:00100000:3.0:1788725935.830241:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935058048 00000100:00100000:3.0:1788725935.830291:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788725935.830300:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935058048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725935.830313:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725935.830326:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10db71e00/0xcbde9110e47c1123 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c111c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725935.830359:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10db71e00/0xcbde9110e47c1123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c111c expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725935.830371:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10db71e00/0xcbde9110e47c1123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c111c expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725935.830380:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10db71e00, rc 0) 00000100:00100000:3.0:1788725935.830430:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935058048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725935.830437:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788725935.830693:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935058048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725935.830708:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e724c00/0xcbde9110e47c111c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1123 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.830717:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e724c00/0xcbde9110e47c111c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c1123 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725935.830771:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935058176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725935.830800:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725935.830821:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a005881b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788725935.830932:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935058176 00000100:00100000:0.0:1788725935.830939:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935058176 00000100:00100000:0.0:1788725935.830965:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788725935.830972:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935058176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725935.831239:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935058176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725935.831246:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788725935.831632:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935058176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725935.831662:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935058304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725935.831703:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725935.831726:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a005881b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788725935.831738:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935058304 00000100:00100000:2.0:1788725935.831742:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935058304 00000100:00100000:2.0:1788725935.831768:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788725935.831774:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935058304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725935.831911:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935058304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725935.831918:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788725935.831955:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935058304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788725935.834717:0:8526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8526:1875614935058432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725935.834802:0:8526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725935.834849:0:8526:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a112949900 going to sleep for 11 seconds 00000100:00100000:2.0:1788725935.834979:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935058432 00000100:00100000:2.0:1788725935.834986:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935058432 00000100:00100000:2.0:1788725935.835037:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788725935.835053:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:8526:x1875614935058432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725935.835298:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:8526:x1875614935058432:12345-0@lo:502:llog_process_th.0 Request processed in 246us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725935.835307:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788725935.835784:0:8526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8526:1875614935058432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788725935.835819:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725935.835829:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725935.835831:0:8526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788725935.835836:0:8526:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a13adc2000 00000020:00000080:3.0:1788725935.835839:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788725935.835926:0:8526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8526:1875614935058560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725935.835964:0:8526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725935.835987:0:8526:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a133aee480 going to sleep for 11 seconds 00000100:00100000:1.0:1788725935.840558:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935058560 00000100:00100000:1.0:1788725935.840572:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935058560 00000100:00100000:1.0:1788725935.841644:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788725935.841659:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:8526:x1875614935058560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725935.853708:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:8526:x1875614935058560:12345-0@lo:502:llog_process_th.0 Request processed in 12042us (17732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725935.853725:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788725935.857343:0:8526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8526:1875614935058560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788725935.857406:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788725935.857417:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725935.857420:0:8526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788725935.857425:0:8526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788725935.859667:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788725935.859699:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788725935.859710:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724c00/0xcbde9110e47c111c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1123 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.859733:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e724c00/0xcbde9110e47c111c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1123 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725935.859743:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788725935.859746:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a10338f800 from 4 10000000:01000000:2.0:1788725935.859749:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788725935.860174:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725200/0xcbde9110e47c112a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.860184:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10e725200/0xcbde9110e47c112a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.860195:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e725200/0xcbde9110e47c112a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725935.860243:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935058688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788725935.860319:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725935.860377:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a005881840 going to sleep for 11 seconds 00000100:00100000:3.0:1788725935.861288:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935058688 00000100:00100000:3.0:1788725935.861298:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935058688 00000100:00100000:3.0:1788725935.861358:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788725935.861369:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935058688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725935.861384:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725935.861398:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10db70600/0xcbde9110e47c1131 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c112a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725935.861421:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10db70600/0xcbde9110e47c1131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c112a expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725935.861431:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10db70600/0xcbde9110e47c1131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c112a expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725935.861440:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10db70600, rc 0) 00000100:00100000:3.0:1788725935.861489:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935058688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725935.861504:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788725935.863794:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935058688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725935.863827:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e725200/0xcbde9110e47c112a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1131 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725935.863840:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e725200/0xcbde9110e47c112a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c1131 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725935.863919:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935058816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725935.864807:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725935.864848:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a11151d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788725935.869728:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935058816 00000100:00100000:1.0:1788725935.869743:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935058816 00000100:00100000:1.0:1788725935.869802:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788725935.869814:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935058816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725935.870098:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935058816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (5293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725935.870106:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788725935.870278:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935058816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725935.870324:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111614700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935058944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725935.870374:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725935.870401:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10339f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788725935.870549:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935058944 00000100:00100000:1.0:1788725935.870553:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935058944 00000100:00100000:1.0:1788725935.870574:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788725935.870580:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935058944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725935.878197:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935058944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7605us (7811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725935.878230:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788725935.882873:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111614700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935058944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725935.892851:0:8532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111617100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8532:1875614935059072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725935.892949:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725935.893001:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935059072 00000100:00100000:1.0:1788725935.893009:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935059072 00000100:00100000:1.0:1788725935.893056:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788725935.893065:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:8532:x1875614935059072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725935.893336:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:8532:x1875614935059072:12345-0@lo:502:llog_process_th.0 Request processed in 271us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725935.893356:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788725935.893403:0:8532:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10408a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788725935.893421:0:8532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111617100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8532:1875614935059072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788725935.893447:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788725935.893455:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725935.893457:0:8532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788725935.893463:0:8532:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a10338f800 00000020:00000080:1.0:1788725935.893465:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788725935.893523:0:8532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111617100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8532:1875614935059200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725935.893553:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725935.893584:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935059200 00000100:00100000:1.0:1788725935.893588:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935059200 00000100:00100000:1.0:1788725935.896329:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788725935.896359:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:8532:x1875614935059200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725935.898642:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:8532:x1875614935059200:12345-0@lo:502:llog_process_th.0 Request processed in 2292us (5079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725935.898952:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788725935.899042:0:8532:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a103381a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788725935.899066:0:8532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111617100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8532:1875614935059200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788725935.899100:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725935.899107:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725935.899110:0:8532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788725935.899114:0:8532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788725935.900697:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788725935.900727:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788725935.900744:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725200/0xcbde9110e47c112a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1131 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.900756:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e725200/0xcbde9110e47c112a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1131 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725935.900768:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788725935.900771:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a120292000 from 4 10000000:01000000:2.0:1788725935.900773:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788725935.900807:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c1138 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.900815:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c1138 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.900825:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c1138 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725935.900847:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935059328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788725935.900908:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725935.900944:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a005881900 going to sleep for 11 seconds 00000100:00100000:2.0:1788725935.900966:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935059328 00000100:00100000:2.0:1788725935.900972:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935059328 00000100:00100000:2.0:1788725935.901012:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788725935.901020:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935059328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725935.901033:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725935.901045:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e724600/0xcbde9110e47c113f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c1138 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.901066:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e724600/0xcbde9110e47c113f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c1138 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.901082:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e724600/0xcbde9110e47c113f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c1138 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.901091:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724600, rc 0) 00000100:00100000:2.0:1788725935.901126:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935059328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725935.901133:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788725935.901171:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935059328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725935.901183:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c1138 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c113f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.901191:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c1138 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c113f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725935.901255:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935059456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725935.901278:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725935.901296:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a005881900 going to sleep for 11 seconds 00000100:00100000:2.0:1788725935.901309:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935059456 00000100:00100000:2.0:1788725935.901312:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935059456 00000100:00100000:2.0:1788725935.901330:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788725935.901336:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935059456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725935.901574:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935059456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725935.901581:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788725935.902508:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935059456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725935.902558:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935059584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725935.902678:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725935.902701:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a005881900 going to sleep for 11 seconds 00000100:00100000:2.0:1788725935.902721:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935059584 00000100:00100000:2.0:1788725935.902726:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935059584 00000100:00100000:2.0:1788725935.902758:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788725935.902764:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935059584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725935.902920:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935059584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725935.902928:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788725935.902970:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005962d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935059584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725935.904943:0:8536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111617100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8536:1875614935059712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725935.905006:0:8536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725935.905039:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935059712 00000100:00100000:1.0:1788725935.905044:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935059712 00000100:00100000:1.0:1788725935.905077:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788725935.905086:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:8536:x1875614935059712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725935.905260:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:8536:x1875614935059712:12345-0@lo:502:llog_process_th.0 Request processed in 174us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725935.905267:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788725935.905310:0:8536:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1033816c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725935.905326:0:8536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111617100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8536:1875614935059712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788725935.906976:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788725935.906989:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725935.906992:0:8536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788725935.906998:0:8536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a120292000 00000020:00000080:1.0:1788725935.907001:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788725935.907441:0:8536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111617100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8536:1875614935059840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725935.907515:0:8536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725935.907556:0:8536:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1033816c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725935.907732:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935059840 00000100:00100000:2.0:1788725935.907740:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935059840 00000100:00100000:2.0:1788725935.907890:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788725935.907900:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:8536:x1875614935059840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725935.908099:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:8536:x1875614935059840:12345-0@lo:502:llog_process_th.0 Request processed in 200us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725935.908106:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788725935.912012:0:8536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111617100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:8536:1875614935059840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788725935.912056:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725935.912065:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725935.912067:0:8536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788725935.912072:0:8536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788725935.912140:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788725935.912158:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788725935.912168:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c1138 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c113f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725935.912178:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c1138 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c113f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.150047:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725936.558958:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725936.559008:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725936.559037:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725936.559061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725936.559095:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914058752 00000100:00100000:0.0:1788725936.559105:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914058752 00000100:00100000:0.0:1788725936.559167:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:0.0:1788725936.559177:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914058752:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788725936.559275:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914058752:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 99us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725936.559283:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:0.0:1788725936.559307:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914059008 00000100:00100000:0.0:1788725936.559311:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914059008 00000100:00100000:0.0:1788725936.559351:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914058880 00000100:00100000:0.0:1788725936.559354:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914058880 00000100:00100000:0.0:1788725936.559373:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:0.0:1788725936.559379:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2349:x1875614914059008:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788725936.559408:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2349:x1875614914059008:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725936.559430:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:0.0:1788725936.559444:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:0.0:1788725936.559450:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2349:x1875614914058880:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788725936.559474:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2349:x1875614914058880:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725936.559480:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:3.0:1788725936.559579:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914058624 00000100:00100000:3.0:1788725936.559584:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914058624 00000100:00100000:3.0:1788725936.559724:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 192 00000100:00100000:3.0:1788725936.559731:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+10:2350:x1875614914058624:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788725936.559869:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+10:2350:x1875614914058624:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725936.559878:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 192 00000100:00080000:3.0:1788725936.559906:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788725936.559910:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788725936.559912:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788725937.174856:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725937.365979:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935060352:0@lo:400:kworker.0 00000100:00100000:3.0:1788725937.366054:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725937.366121:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725937.366143:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935060224:0@lo:400:kworker.0 00000100:00100000:3.0:1788725937.366174:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725937.366237:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935060224 00000100:00100000:3.0:1788725937.366245:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935060224 00000100:00100000:3.0:1788725937.366301:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788725937.366311:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935060224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725937.366380:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935060224:12345-0@lo:400:kworker.0 Request processed in 70us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725937.366388:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788725937.366409:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788725937.366436:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1089b0700 x1875614935060224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725937.366450:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935060224:0@lo:400:kworker.0 00000100:00100000:0.0:1788725937.367498:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935060096:0@lo:400:kworker.0 00000100:00100000:0.0:1788725937.367549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725937.367586:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935060608:0@lo:400:kworker.0 00000100:00100000:0.0:1788725937.367625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725937.367658:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788725937.367665:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935059968:0@lo:400:kworker.0 00000100:00100000:0.0:1788725937.367690:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725937.367711:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935060480:0@lo:400:kworker.0 00000100:00100000:1.0:1788725937.367721:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935060352 00000100:00100000:1.0:1788725937.367727:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935060352 00000100:00100000:0.0:1788725937.367729:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725937.367754:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935060608 00000100:00100000:0.0:1788725937.367757:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935060608 00000100:00100000:1.0:1788725937.367782:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935060096 00000100:00100000:0.0:1788725937.367784:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788725937.367785:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935060096 00000100:00100000:0.0:1788725937.367792:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935060608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725937.367799:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935060480 00000100:00100000:1.0:1788725937.367800:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935060480 00000100:00100000:1.0:1788725937.367813:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788725937.367819:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935060352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725937.367833:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935060608:12345-0@lo:400:kworker.0 Request processed in 41us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725937.367839:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788725937.367852:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935060352:12345-0@lo:400:kworker.0 Request processed in 34us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725937.367858:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788725937.367862:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788725937.367868:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788725937.367868:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935060096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725937.367873:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935060480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725937.367897:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935060480:12345-0@lo:400:kworker.0 Request processed in 24us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725937.367901:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935060096:12345-0@lo:400:kworker.0 Request processed in 34us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725937.367903:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788725937.367925:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788725937.367929:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725937.367975:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935060480:0@lo:400:kworker.0 00000100:00100000:1.0:1788725937.367985:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935060096:0@lo:400:kworker.0 00000100:00100000:2.0:1788725937.367988:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935059968 00000100:00100000:2.0:1788725937.367992:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935059968 00010000:00080000:1.0:1788725937.367995:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1089b3480 x1875614935060608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725937.368005:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935060608:0@lo:400:kworker.0 00000100:00100000:2.0:1788725937.368016:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788725937.368023:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935059968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725937.368056:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935059968:12345-0@lo:400:kworker.0 Request processed in 34us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725937.368066:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935059968:0@lo:400:kworker.0 00000100:00100000:2.0:1788725937.368071:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788725937.368404:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935060352:0@lo:400:kworker.0 00000100:00100000:0.0:1788725937.373781:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788725937.878025:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935060736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725937.878118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725937.878326:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935060736 00000100:00100000:3.0:1788725937.878336:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935060736 00000100:00100000:3.0:1788725937.878388:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788725937.878397:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935060736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725937.878431:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788725937.878489:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935060736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725937.878497:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788725937.878641:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a005962d80 x1875614935060736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725937.878658:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935060736:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788725938.197552:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725938.901431:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725938.901455:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935060864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725938.901538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725938.901737:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935060864 00000100:00100000:2.0:1788725938.901746:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935060864 00000100:00100000:2.0:1788725938.901801:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788725938.901811:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935060864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788725938.901848:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788725938.901898:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935060864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725938.901916:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788725938.902186:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a005962300 x1875614935060864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725938.902206:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935060864:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788725939.221775:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725940.245508:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725941.274903:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725941.676532:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725941.676577:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725941.676601:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725941.676625:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725941.676652:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914059392 00000100:00100000:0.0:1788725941.676662:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914059392 00000100:00100000:0.0:1788725941.676714:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914059520 00000100:00100000:0.0:1788725941.676717:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914059520 00000100:00100000:0.0:1788725941.676738:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:0.0:1788725941.676748:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914059392:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788725941.676822:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914059392:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 75us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725941.676830:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:0.0:1788725941.676858:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:0.0:1788725941.676867:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914059520:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788725941.676892:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914059520:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 27us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725941.676899:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:1.0:1788725941.677271:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914059136 00000100:00100000:1.0:1788725941.677277:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914059136 00000100:00100000:1.0:1788725941.677307:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 194 00000100:00100000:1.0:1788725941.677315:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:2351:x1875614914059136:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788725941.683293:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:2351:x1875614914059136:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 5964us (6757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725941.683309:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 194 00000100:00100000:1.0:1788725941.683386:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914059264 00000100:00100000:1.0:1788725941.683396:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914059264 00000100:00100000:1.0:1788725941.683443:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:1.0:1788725941.683454:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2351:x1875614914059264:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788725941.683518:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2351:x1875614914059264:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 68us (6917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725941.683525:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00080000:1.0:1788725941.683541:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788725941.683546:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788725941.683548:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788725942.006996:0:8796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1788725942.295565:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725942.488616:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935061248:0@lo:400:kworker.0 00000100:00100000:1.0:1788725942.488616:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935061376:0@lo:400:kworker.0 00000100:00100000:2.0:1788725942.488705:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935060992:0@lo:400:kworker.0 00000100:00100000:0.0:1788725942.488868:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935061120:0@lo:400:kworker.0 00000100:00100000:1.0:1788725942.491179:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725942.491303:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935061376 00000100:00100000:1.0:1788725942.491310:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935061376 00000100:00100000:1.0:1788725942.491368:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788725942.491382:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935061376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725942.491443:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935061376:12345-0@lo:400:kworker.0 Request processed in 67us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725942.491450:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788725942.491470:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725942.491503:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935061376:0@lo:400:kworker.0 00000100:00100000:3.0:1788725942.495292:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725942.502618:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935061248 00000100:00100000:1.0:1788725942.502635:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935061248 00000100:00100000:1.0:1788725942.502765:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788725942.502779:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935061248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725942.502884:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935061248:12345-0@lo:400:kworker.0 Request processed in 110us (7599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725942.502891:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788725942.502941:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a111617b80 x1875614935061248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725942.502957:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935061248:0@lo:400:kworker.0 00000100:00080000:3.0:1788725942.503324:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725942.506505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725942.506578:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935061504:0@lo:400:kworker.0 00000100:00100000:2.0:1788725942.506620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725942.506783:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935060992 00000100:00100000:3.0:1788725942.506793:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935060992 00000100:00100000:3.0:1788725942.506859:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788725942.506872:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935060992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725942.506943:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935060992:12345-0@lo:400:kworker.0 Request processed in 73us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725942.506951:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788725942.507261:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935060992:0@lo:400:kworker.0 00000100:00100000:1.0:1788725942.507775:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935061504 00000100:00100000:1.0:1788725942.507781:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935061504 00000100:00100000:1.0:1788725942.507841:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788725942.507850:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935061504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725942.507901:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935061504:12345-0@lo:400:kworker.0 Request processed in 52us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725942.507907:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788725942.508028:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725942.508580:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935061504:0@lo:400:kworker.0 00000100:00100000:0.0:1788725942.508989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725942.509326:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935061632:0@lo:400:kworker.0 00000100:00100000:0.0:1788725942.509358:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725942.509545:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935061632 00000100:00100000:2.0:1788725942.509552:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935061632 00000100:00100000:2.0:1788725942.509618:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788725942.509628:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935061632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725942.509684:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935061632:12345-0@lo:400:kworker.0 Request processed in 57us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725942.509700:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788725942.509734:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a111614e00 x1875614935061632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725942.509747:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935061632:0@lo:400:kworker.0 00000100:00080000:3.0:1788725942.509823:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725942.517330:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935061120 00000100:00100000:1.0:1788725942.517348:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935061120 00000100:00100000:1.0:1788725942.517470:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788725942.517482:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935061120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725942.517593:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935061120:12345-0@lo:400:kworker.0 Request processed in 113us (8604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725942.517601:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788725942.517706:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935061120:0@lo:400:kworker.0 00000100:00100000:0.0:1788725943.000739:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725943.000781:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935061760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788725943.000888:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725943.000996:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935061760 00000100:00100000:0.0:1788725943.001006:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935061760 00000100:00100000:0.0:1788725943.001072:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788725943.001084:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935061760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788725943.001130:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788725943.001183:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935061760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725943.001191:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788725943.001274:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a005961180 x1875614935061760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725943.001297:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935061760:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788725943.319446:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725944.022400:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725944.022441:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935061888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725944.022557:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725944.022652:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935061888 00000100:00100000:1.0:1788725944.022670:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935061888 00000100:00100000:1.0:1788725944.022747:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788725944.022760:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935061888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788725944.022810:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788725944.022869:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935061888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725944.022876:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788725944.022942:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a111617b80 x1875614935061888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725944.022965:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935061888:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788725944.023545:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788725944.342083:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725945.367069:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725946.392198:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725946.806582:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725946.806809:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914059904 00000100:00100000:3.0:1788725946.806820:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914059904 00000100:00100000:3.0:1788725946.806893:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:3.0:1788725946.806903:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2348:x1875614914059904:12345-192.168.201.42@tcp:9:kworker.0 00000020:00000080:3.0:1788725946.806940:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c107b 00000100:00080000:3.0:1788725946.806950:0:6682:0:(import.c:65:import_set_state_nolock()) ffff91a139f00000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788725946.806989:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1788725946.807458:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788725946.807500:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725946.808288:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+2:2348:x1875614914059904:12345-192.168.201.42@tcp:9:kworker.0 Request processed in 776us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725946.808302:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:1.0:1788725946.823038:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725946.823563:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914059648 00000100:00100000:3.0:1788725946.823575:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914059648 00000100:00100000:3.0:1788725946.823629:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 196 00000100:00100000:3.0:1788725946.823639:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:2351:x1875614914059648:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788725946.823840:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:2351:x1875614914059648:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 202us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725946.823859:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 196 00000100:00100000:3.0:1788725946.827694:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725946.827839:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914060032 00000100:00100000:1.0:1788725946.827850:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914060032 00000100:00100000:1.0:1788725946.827917:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:1.0:1788725946.827930:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2348:x1875614914060032:12345-192.168.201.42@tcp:9:kworker.0 00000020:00000080:1.0:1788725946.827964:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c1082 00000100:00080000:1.0:1788725946.827974:0:6680:0:(import.c:65:import_set_state_nolock()) ffff91a141af9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788725946.828008:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788725946.828417:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+2:2348:x1875614914060032:12345-192.168.201.42@tcp:9:kworker.0 Request processed in 489us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725946.828424:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00010000:00010000:1.0:1788725946.828481:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788725946.829063:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788725946.842013:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725946.842638:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914059776 00000100:00100000:1.0:1788725946.842648:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914059776 00000100:00080000:3.0:1788725946.842879:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725946.842968:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:1.0:1788725946.842980:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2351:x1875614914059776:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788725946.843072:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2351:x1875614914059776:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 95us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725946.843081:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00010000:00010000:2.0:1788725947.415200:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725947.605418:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935062144:0@lo:400:kworker.0 00000100:00100000:1.0:1788725947.605491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725947.605550:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935062656:0@lo:400:kworker.0 00000100:00100000:1.0:1788725947.605578:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725947.605608:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788725947.605614:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935062016:0@lo:400:kworker.0 00000100:00100000:1.0:1788725947.605643:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725947.605665:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935062528:0@lo:400:kworker.0 00000100:00100000:1.0:1788725947.605688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725947.605713:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935062272:0@lo:400:kworker.0 00000100:00100000:1.0:1788725947.605733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725947.605750:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725947.605756:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935062400:0@lo:400:kworker.0 00000100:00100000:1.0:1788725947.605774:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725947.605804:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935062144 00000100:00100000:1.0:1788725947.605812:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935062144 00000100:00100000:1.0:1788725947.605855:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935062528 00000100:00100000:1.0:1788725947.605859:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935062528 00000100:00100000:1.0:1788725947.605893:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935062400 00000100:00100000:1.0:1788725947.605897:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935062400 00000100:00100000:1.0:1788725947.605914:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788725947.605921:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935062144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725947.605973:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935062144:12345-0@lo:400:kworker.0 Request processed in 52us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725947.605989:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788725947.606006:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788725947.606013:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935062528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725947.606040:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935062528:12345-0@lo:400:kworker.0 Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725947.606046:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788725947.606057:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788725947.606063:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935062400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725947.606094:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935062400:12345-0@lo:400:kworker.0 Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725947.606101:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788725947.606118:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935062016 00000100:00100000:1.0:1788725947.606122:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935062016 00000100:00100000:1.0:1788725947.606144:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788725947.606163:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935062016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725947.606193:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935062016:12345-0@lo:400:kworker.0 Request processed in 31us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725947.606199:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788725947.606246:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935062656 00000100:00100000:1.0:1788725947.606251:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935062656 00000100:00100000:1.0:1788725947.606274:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935062272 00000100:00100000:1.0:1788725947.606277:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935062272 00000100:00100000:1.0:1788725947.606289:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788725947.606294:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935062656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725947.606322:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935062656:12345-0@lo:400:kworker.0 Request processed in 28us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725947.606336:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788725947.606346:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788725947.606351:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935062272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725947.606380:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935062272:12345-0@lo:400:kworker.0 Request processed in 29us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725947.606385:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788725947.606432:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935062400:0@lo:400:kworker.0 00010000:00080000:1.0:1788725947.606446:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a111615500 x1875614935062272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725947.606457:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935062272:0@lo:400:kworker.0 00000100:00100000:1.0:1788725947.606486:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935062016:0@lo:400:kworker.0 00000100:00100000:1.0:1788725947.606495:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935062528:0@lo:400:kworker.0 00000100:00100000:1.0:1788725947.606503:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935062144:0@lo:400:kworker.0 00010000:00080000:1.0:1788725947.606512:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a111614380 x1875614935062656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725947.606520:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935062656:0@lo:400:kworker.0 00000100:00080000:3.0:1788725947.606912:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788725947.606917:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788725947.606919:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725948.119886:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935062784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725948.119971:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725948.120151:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935062784 00000100:00100000:0.0:1788725948.120161:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935062784 00000100:00100000:0.0:1788725948.120245:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788725948.120257:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935062784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788725948.120296:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788725948.120347:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935062784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725948.120354:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788725948.120402:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a9c4e00 x1875614935062784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725948.120442:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935062784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788725948.442363:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788725948.918267:0:9040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing yml_node 00000100:00100000:2.0:1788725949.145364:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935062912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725949.145440:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725949.145608:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935062912 00000100:00100000:0.0:1788725949.145617:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935062912 00000100:00100000:0.0:1788725949.145687:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788725949.145698:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935062912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788725949.145737:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788725949.145785:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935062912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725949.145792:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788725949.145833:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1089b3800 x1875614935062912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725949.145850:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935062912:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788725949.146093:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788725949.473944:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725950.489255:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788725951.275756:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000020:00000080:3.0:1788725951.275774:0:6711:0:(genops.c:885:class_export_put()) final put ffff91a139f01800/7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000020:00000080:2.0:1788725951.275988:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a139f01800/7c11f8bd-dcce-4bc6-a067-83d611fb0a24 for lustre-OST0000 00000020:00000080:2.0:1788725951.276036:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a139f00000 for lustre-OST0000 00000001:00100000:1.0:1788725951.281688:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000020:00000080:1.0:1788725951.281710:0:7632:0:(genops.c:885:class_export_put()) final put ffff91a141af8000/7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000020:00000080:0.0:1788725951.282194:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91a141af8000/7c11f8bd-dcce-4bc6-a067-83d611fb0a24 for lustre-OST0001 00000020:00000080:0.0:1788725951.282386:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a141af9800 for lustre-OST0001 00010000:00010000:2.0:1788725951.509516:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725951.910527:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725951.910619:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725951.910741:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914060160 00000100:00100000:3.0:1788725951.910751:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914060160 00000100:00100000:3.0:1788725951.910808:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 198 00000100:00100000:3.0:1788725951.910819:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:2350:x1875614914060160:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788725951.910892:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:2350:x1875614914060160:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 74us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725951.910900:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 198 00000100:00100000:0.0:1788725951.911023:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914060288 00000100:00100000:0.0:1788725951.911029:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914060288 00000100:00100000:0.0:1788725951.911094:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:0.0:1788725951.911102:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914060288:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788725951.911137:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914060288:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 36us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725951.911143:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00080000:3.0:1788725951.911271:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788725952.533671:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725952.725664:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935063040:0@lo:400:kworker.0 00000100:00100000:3.0:1788725952.725740:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725952.725810:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935063552:0@lo:400:kworker.0 00000100:00100000:3.0:1788725952.725838:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725952.725864:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788725952.725871:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935063168:0@lo:400:kworker.0 00000100:00100000:3.0:1788725952.725894:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725952.725909:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935063680:0@lo:400:kworker.0 00000100:00100000:3.0:1788725952.725932:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725952.726084:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935063296:0@lo:400:kworker.0 00000100:00100000:0.0:1788725952.726112:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725952.726144:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788725952.726150:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935063424:0@lo:400:kworker.0 00000100:00100000:0.0:1788725952.726173:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725952.726203:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935063552 00000100:00100000:0.0:1788725952.726209:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935063552 00000100:00100000:0.0:1788725952.726294:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935063168 00000100:00100000:0.0:1788725952.726298:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935063168 00000100:00100000:0.0:1788725952.726387:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935063424 00000100:00100000:0.0:1788725952.726391:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935063424 00000100:00100000:0.0:1788725952.726413:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788725952.726421:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935063552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725952.726478:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935063552:12345-0@lo:400:kworker.0 Request processed in 58us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725952.726485:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788725952.726501:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788725952.726506:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935063168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725952.726531:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935063168:12345-0@lo:400:kworker.0 Request processed in 25us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725952.726537:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788725952.726547:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788725952.726553:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935063424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725952.726581:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935063424:12345-0@lo:400:kworker.0 Request processed in 28us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725952.726587:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788725952.726602:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725952.726646:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935063424:0@lo:400:kworker.0 00000100:00100000:0.0:1788725952.726675:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935063168:0@lo:400:kworker.0 00000100:00100000:0.0:1788725952.726695:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935063552:0@lo:400:kworker.0 00000100:00100000:3.0:1788725952.726878:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935063680 00000100:00100000:3.0:1788725952.726882:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935063680 00000100:00100000:3.0:1788725952.726923:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935063296 00000100:00100000:3.0:1788725952.726927:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935063296 00000100:00100000:3.0:1788725952.726941:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788725952.726947:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935063680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725952.726984:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935063680:12345-0@lo:400:kworker.0 Request processed in 37us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725952.726989:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788725952.726999:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788725952.727004:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935063296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725952.727030:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935063296:12345-0@lo:400:kworker.0 Request processed in 26us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725952.727035:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788725952.727072:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a005962300 x1875614935063296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725952.727084:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935063296:0@lo:400:kworker.0 00010000:00080000:3.0:1788725952.727109:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a005963100 x1875614935063680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725952.727118:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935063680:0@lo:400:kworker.0 00000100:00100000:2.0:1788725952.727189:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935063040 00000100:00100000:2.0:1788725952.727194:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935063040 00000100:00100000:2.0:1788725952.727273:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788725952.727282:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935063040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725952.727589:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935063040:12345-0@lo:400:kworker.0 Request processed in 308us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725952.727596:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788725952.727637:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935063040:0@lo:400:kworker.0 00000100:00080000:0.0:1788725952.727977:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788725952.727982:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725953.244612:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935063808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788725953.244690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725953.244820:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935063808 00000100:00100000:3.0:1788725953.244829:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935063808 00000100:00100000:3.0:1788725953.244886:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788725953.244896:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935063808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725953.244934:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788725953.244984:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935063808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725953.245001:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788725953.245047:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1089b3800 x1875614935063808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725953.245078:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935063808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788725953.569522:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788725953.924586:0:9235:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00000100:00100000:1.0:1788725954.261664:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725954.261690:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935063936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725954.261759:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725954.261898:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935063936 00000100:00100000:3.0:1788725954.261906:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935063936 00000100:00100000:3.0:1788725954.261968:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788725954.261977:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935063936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788725954.262011:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788725954.262071:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935063936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725954.262079:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788725954.262121:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1089b3800 x1875614935063936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725954.262139:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935063936:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788725954.262204:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788725954.581543:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725955.605462:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725956.646341:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788725956.669084:0:9333:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00000100:00100000:0.0:1788725957.041094:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725957.041567:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725957.044404:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914060416 00000100:00100000:1.0:1788725957.044420:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914060416 00000100:00100000:1.0:1788725957.044483:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 200 00000100:00100000:1.0:1788725957.044494:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+10:2350:x1875614914060416:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788725957.044579:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+10:2350:x1875614914060416:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 87us (3012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725957.044587:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 200 00000100:00100000:3.0:1788725957.049760:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914060544 00000100:00100000:3.0:1788725957.049777:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914060544 00000100:00100000:0.0:1788725957.050022:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:0.0:1788725957.050034:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914060544:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788725957.050129:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914060544:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 98us (9046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725957.050137:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00080000:3.0:1788725957.050539:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788725957.655348:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725957.847047:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935064192:0@lo:400:kworker.0 00000100:00100000:1.0:1788725957.847118:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725957.847175:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935064704:0@lo:400:kworker.0 00000100:00100000:1.0:1788725957.847206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725957.847253:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788725957.847259:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935064064:0@lo:400:kworker.0 00000100:00100000:1.0:1788725957.847286:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725957.847306:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935064576:0@lo:400:kworker.0 00000100:00100000:1.0:1788725957.847353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725957.847384:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935064320:0@lo:400:kworker.0 00000100:00100000:1.0:1788725957.847408:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725957.847426:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725957.847431:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111614700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935064448:0@lo:400:kworker.0 00000100:00100000:1.0:1788725957.847451:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725957.847481:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935064192 00000100:00100000:1.0:1788725957.847488:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935064192 00000100:00100000:1.0:1788725957.847529:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935064576 00000100:00100000:1.0:1788725957.847532:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935064576 00000100:00100000:1.0:1788725957.847564:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935064448 00000100:00100000:1.0:1788725957.847568:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935064448 00000100:00100000:1.0:1788725957.847583:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788725957.847591:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935064192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725957.847642:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935064192:12345-0@lo:400:kworker.0 Request processed in 51us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725957.847649:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788725957.847665:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788725957.847671:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935064576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725957.847695:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935064576:12345-0@lo:400:kworker.0 Request processed in 25us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725957.847701:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788725957.847710:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788725957.847716:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935064448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725957.847742:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935064448:12345-0@lo:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725957.847748:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788725957.847770:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935064704 00000100:00100000:1.0:1788725957.847773:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935064704 00000100:00100000:1.0:1788725957.847798:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935064320 00000100:00100000:1.0:1788725957.847801:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935064320 00000100:00100000:1.0:1788725957.847814:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788725957.847820:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935064704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725957.847848:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935064704:12345-0@lo:400:kworker.0 Request processed in 29us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725957.847854:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788725957.847863:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788725957.847869:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935064320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725957.847890:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935064320:12345-0@lo:400:kworker.0 Request processed in 22us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725957.847896:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788725957.847910:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935064064 00000100:00100000:1.0:1788725957.847913:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935064064 00000100:00100000:1.0:1788725957.847933:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788725957.847938:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935064064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725957.847967:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935064064:12345-0@lo:400:kworker.0 Request processed in 28us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725957.847984:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788725957.848043:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111614700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935064448:0@lo:400:kworker.0 00010000:00080000:1.0:1788725957.848056:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a111614a80 x1875614935064320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725957.848066:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935064320:0@lo:400:kworker.0 00000100:00100000:1.0:1788725957.848096:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935064064:0@lo:400:kworker.0 00000100:00100000:1.0:1788725957.848114:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935064576:0@lo:400:kworker.0 00000100:00100000:1.0:1788725957.848122:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935064192:0@lo:400:kworker.0 00010000:00080000:1.0:1788725957.848132:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a139867100 x1875614935064704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725957.848139:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935064704:0@lo:400:kworker.0 00000100:00080000:3.0:1788725957.848873:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788725957.848879:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788725957.848882:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725958.357568:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935064832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725958.357652:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725958.357772:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935064832 00000100:00100000:0.0:1788725958.357781:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935064832 00000100:00100000:0.0:1788725958.357839:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788725958.357849:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935064832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788725958.357885:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788725958.363828:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935064832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5969us (6165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725958.363845:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788725958.366861:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1089b3800 x1875614935064832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725958.366895:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935064832:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788725958.679013:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725959.381506:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725959.381530:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935064960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725959.381611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725959.381796:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935064960 00000100:00100000:3.0:1788725959.381805:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935064960 00000100:00100000:3.0:1788725959.381874:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788725959.381884:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935064960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788725959.381921:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788725959.382007:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935064960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725959.382015:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788725959.382136:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1089b3800 x1875614935064960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725959.382155:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935064960:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788725959.382232:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788725959.576587:0:9431:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00010000:00010000:0.0:1788725959.706496:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725960.728453:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788725961.506607:0:9480:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sun Sep 6 16:19:19 EDT 2026 00010000:00010000:0.0:1788725961.752083:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725962.155609:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725962.155662:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725962.155794:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914060672 00000100:00100000:1.0:1788725962.155805:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914060672 00000100:00100000:1.0:1788725962.155871:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 202 00000100:00100000:1.0:1788725962.155882:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:2350:x1875614914060672:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788725962.155987:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:2350:x1875614914060672:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 106us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725962.155995:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 202 00000100:00100000:2.0:1788725962.156521:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914060800 00000100:00100000:2.0:1788725962.156528:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914060800 00000100:00100000:2.0:1788725962.156585:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:2.0:1788725962.156594:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914060800:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:0.0:1788725962.156711:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725962.157431:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914060800:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 835us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725962.157440:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00010000:00010000:1.0:1788725962.776461:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725962.967971:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935065216:0@lo:400:kworker.0 00000100:00100000:0.0:1788725962.968044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725962.968118:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935065728:0@lo:400:kworker.0 00000100:00100000:0.0:1788725962.968153:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725962.968187:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788725962.968193:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935065088:0@lo:400:kworker.0 00000100:00100000:0.0:1788725962.968234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725962.968264:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935065600:0@lo:400:kworker.0 00000100:00100000:0.0:1788725962.968287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725962.968318:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935065728 00000100:00100000:0.0:1788725962.968326:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935065728 00000100:00100000:0.0:1788725962.968386:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788725962.968396:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935065728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725962.968449:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935065728:12345-0@lo:400:kworker.0 Request processed in 55us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725962.968456:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788725962.968477:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935065088 00000100:00100000:0.0:1788725962.968481:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935065088 00000100:00100000:0.0:1788725962.968505:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788725962.968510:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935065088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725962.968540:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935065088:12345-0@lo:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725962.968546:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788725962.968579:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935065216 00000100:00100000:0.0:1788725962.968582:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935065216 00000100:00100000:0.0:1788725962.968604:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935065600 00000100:00100000:0.0:1788725962.968608:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935065600 00000100:00100000:0.0:1788725962.968628:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788725962.968634:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935065216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725962.968666:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935065216:12345-0@lo:400:kworker.0 Request processed in 32us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725962.968685:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788725962.968696:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788725962.968702:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935065600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725962.968725:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935065600:12345-0@lo:400:kworker.0 Request processed in 25us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725962.968731:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788725962.968746:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788725962.968751:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725962.968787:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935065088:0@lo:400:kworker.0 00000100:00100000:0.0:1788725962.968802:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935065600:0@lo:400:kworker.0 00000100:00100000:0.0:1788725962.968811:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935065216:0@lo:400:kworker.0 00010000:00080000:0.0:1788725962.968822:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a111613480 x1875614935065728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725962.968831:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935065728:0@lo:400:kworker.0 00000100:00100000:2.0:1788725962.969591:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935065344:0@lo:400:kworker.0 00000100:00100000:2.0:1788725962.969631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725962.969748:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935065344 00000100:00100000:0.0:1788725962.969755:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935065344 00000100:00100000:2.0:1788725962.969810:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788725962.969820:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935065472:0@lo:400:kworker.0 00000100:00100000:2.0:1788725962.969846:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725962.969875:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935065472 00000100:00100000:2.0:1788725962.969878:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935065472 00000100:00100000:0.0:1788725962.969943:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788725962.969951:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935065344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725962.969999:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935065344:12345-0@lo:400:kworker.0 Request processed in 49us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725962.970007:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788725962.970375:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788725962.970384:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788725962.970424:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a111610a80 x1875614935065344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725962.970437:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935065344:0@lo:400:kworker.0 00000100:00100000:2.0:1788725962.970536:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788725962.970543:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935065472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725962.970580:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935065472:12345-0@lo:400:kworker.0 Request processed in 38us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725962.970587:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788725962.970655:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935065472:0@lo:400:kworker.0 00000100:00100000:1.0:1788725963.478000:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788725963.484411:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935065856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725963.484493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725963.484604:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935065856 00000100:00100000:2.0:1788725963.484613:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935065856 00000100:00100000:2.0:1788725963.484668:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788725963.484678:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935065856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788725963.484734:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788725963.484785:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935065856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725963.484792:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788725963.484874:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a111612680 x1875614935065856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725963.484905:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935065856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788725963.799098:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725964.502227:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788725964.502257:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935065984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725964.502330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725964.502555:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935065984 00000100:00100000:1.0:1788725964.502564:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935065984 00000100:00100000:1.0:1788725964.502627:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788725964.502639:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935065984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788725964.502676:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788725964.502722:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935065984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725964.502729:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788725964.505280:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788725964.505341:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a005961500 x1875614935065984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725964.505367:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935065984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788725964.821433:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725965.845397:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725966.871265:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725967.270309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725967.270356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725967.270390:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914060928 00000100:00100000:1.0:1788725967.270400:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914060928 00000100:00100000:1.0:1788725967.270448:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 204 00000100:00100000:1.0:1788725967.270458:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:2352:x1875614914060928:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788725967.270617:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914061056 00000100:00100000:2.0:1788725967.270622:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914061056 00000100:00100000:2.0:1788725967.270660:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:2.0:1788725967.270668:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2352:x1875614914061056:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788725967.270715:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2352:x1875614914061056:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 49us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725967.270722:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00080000:2.0:1788725967.270742:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725967.270888:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+10:2352:x1875614914060928:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 430us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725967.270895:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 204 00010000:00010000:0.0:1788725967.901981:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725968.085620:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935066496:0@lo:400:kworker.0 00000100:00100000:2.0:1788725968.085680:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935066112:0@lo:400:kworker.0 00000100:00100000:1.0:1788725968.085692:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725968.085756:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935066368:0@lo:400:kworker.0 00000100:00100000:2.0:1788725968.085757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725968.085810:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935066624:0@lo:400:kworker.0 00000100:00100000:2.0:1788725968.085834:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725968.085862:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788725968.085881:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935066496 00000100:00100000:2.0:1788725968.085885:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935066240:0@lo:400:kworker.0 00000100:00100000:1.0:1788725968.085889:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935066496 00000100:00100000:2.0:1788725968.085908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725968.085923:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935066752:0@lo:400:kworker.0 00000100:00100000:1.0:1788725968.085941:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935066624 00000100:00100000:2.0:1788725968.085943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725968.085944:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935066624 00000100:00100000:2.0:1788725968.085966:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935066240 00000100:00100000:2.0:1788725968.085969:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935066240 00000100:00100000:1.0:1788725968.085974:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788725968.085982:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935066496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725968.085985:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788725968.085990:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935066624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725968.086030:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935066624:12345-0@lo:400:kworker.0 Request processed in 39us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725968.086034:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935066496:12345-0@lo:400:kworker.0 Request processed in 53us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725968.086037:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788725968.086039:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788725968.086051:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788725968.086056:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935066240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725968.086079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725968.086081:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935066240:12345-0@lo:400:kworker.0 Request processed in 25us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725968.086136:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935066112 00000100:00100000:0.0:1788725968.086141:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935066112 00000100:00100000:0.0:1788725968.086169:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788725968.086175:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935066112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725968.086296:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935066112:12345-0@lo:400:kworker.0 Request processed in 121us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725968.086302:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788725968.086334:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935066752 00000100:00100000:0.0:1788725968.086338:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935066752 00000100:00100000:0.0:1788725968.086367:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935066368 00000100:00100000:0.0:1788725968.086370:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935066368 00000100:00100000:0.0:1788725968.086389:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788725968.086395:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935066752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725968.086645:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788725968.086652:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788725968.086657:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788725968.086659:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725968.086686:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935066240:0@lo:400:kworker.0 00000100:00100000:1.0:1788725968.086686:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935066496:0@lo:400:kworker.0 00000100:00100000:2.0:1788725968.086696:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935066112:0@lo:400:kworker.0 00000100:00100000:2.0:1788725968.086704:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935066624:0@lo:400:kworker.0 00000100:00100000:1.0:1788725968.087281:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788725968.087292:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788725968.087326:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788725968.087335:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788725968.087344:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935066368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725968.087938:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935066752:12345-0@lo:400:kworker.0 Request processed in 1540us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725968.087948:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788725968.087987:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1116f0000 x1875614935066752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725968.088021:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935066752:0@lo:400:kworker.0 00000100:00100000:1.0:1788725968.090101:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935066368:12345-0@lo:400:kworker.0 Request processed in 2739us (4001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725968.090117:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788725968.090279:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1116f3800 x1875614935066368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725968.090293:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935066368:0@lo:400:kworker.0 00000100:00100000:1.0:1788725968.597421:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788725968.597445:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935066880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725968.597515:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725968.597614:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935066880 00000100:00100000:3.0:1788725968.597622:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935066880 00000100:00100000:3.0:1788725968.597711:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788725968.597721:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935066880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725968.597760:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788725968.597817:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935066880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725968.597823:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788725968.597905:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a111611f80 x1875614935066880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725968.597923:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935066880:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788725968.921941:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725969.632173:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935067008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788725969.632258:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725969.632330:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935067008 00000100:00100000:3.0:1788725969.632342:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935067008 00000100:00100000:3.0:1788725969.632387:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788725969.632396:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935067008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788725969.632435:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788725969.632477:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935067008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725969.632484:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788725969.632527:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a111611180 x1875614935067008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725969.632544:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935067008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788725969.944136:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725970.966433:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725971.990842:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725972.395238:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725972.395278:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725972.395306:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914061312 00000100:00100000:1.0:1788725972.395315:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914061312 00000100:00100000:1.0:1788725972.395365:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:1.0:1788725972.395374:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2352:x1875614914061312:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788725972.395431:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2352:x1875614914061312:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 60us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725972.395446:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:1.0:1788725972.395464:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914061184 00000100:00100000:1.0:1788725972.395466:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914061184 00000100:00100000:1.0:1788725972.395483:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 206 00000100:00100000:1.0:1788725972.395486:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+10:2352:x1875614914061184:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788725972.395507:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+10:2352:x1875614914061184:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 21us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725972.395510:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 206 00000100:00080000:1.0:1788725972.395527:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788725973.013436:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725973.205431:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935067392:0@lo:400:kworker.0 00000100:00100000:3.0:1788725973.205496:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725973.205539:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725973.205543:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935067520:0@lo:400:kworker.0 00000100:00100000:3.0:1788725973.205558:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725973.205583:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935067392 00000100:00100000:3.0:1788725973.205589:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935067392 00000100:00100000:3.0:1788725973.205658:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788725973.205667:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935067392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725973.205734:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935067392:12345-0@lo:400:kworker.0 Request processed in 68us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725973.205741:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788725973.205762:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935067520 00000100:00100000:3.0:1788725973.205766:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935067520 00000100:00100000:3.0:1788725973.205794:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788725973.205800:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935067520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725973.205839:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935067520:12345-0@lo:400:kworker.0 Request processed in 40us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725973.205846:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788725973.205863:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788725973.205867:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725973.205905:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935067520:0@lo:400:kworker.0 00010000:00080000:3.0:1788725973.205920:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a111612d80 x1875614935067392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725973.205930:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935067392:0@lo:400:kworker.0 00000100:00100000:1.0:1788725973.206063:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935067264:0@lo:400:kworker.0 00000100:00100000:1.0:1788725973.206093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725973.206128:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935067776:0@lo:400:kworker.0 00000100:00100000:1.0:1788725973.206147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725973.206255:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788725973.206261:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935067136:0@lo:400:kworker.0 00000100:00100000:1.0:1788725973.206287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725973.206304:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935067648:0@lo:400:kworker.0 00000100:00100000:1.0:1788725973.206319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725973.206339:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935067136 00000100:00100000:1.0:1788725973.206343:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935067136 00000100:00100000:1.0:1788725973.206367:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788725973.206372:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935067136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725973.206402:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935067136:12345-0@lo:400:kworker.0 Request processed in 30us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725973.206416:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788725973.206439:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935067264 00000100:00100000:1.0:1788725973.206442:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935067264 00000100:00100000:1.0:1788725973.206458:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935067648 00000100:00100000:1.0:1788725973.206460:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935067648 00000100:00100000:1.0:1788725973.206476:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788725973.206481:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935067264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725973.206504:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935067264:12345-0@lo:400:kworker.0 Request processed in 23us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725973.206509:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788725973.206517:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788725973.206521:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935067648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725973.206547:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935067648:12345-0@lo:400:kworker.0 Request processed in 25us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725973.206552:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788725973.206581:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935067136:0@lo:400:kworker.0 00000100:00100000:1.0:1788725973.206591:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935067648:0@lo:400:kworker.0 00000100:00100000:1.0:1788725973.206600:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935067264:0@lo:400:kworker.0 00000100:00080000:3.0:1788725973.206674:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725973.206827:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935067776 00000100:00100000:0.0:1788725973.206832:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935067776 00000100:00100000:0.0:1788725973.206875:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788725973.206882:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935067776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725973.206918:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935067776:12345-0@lo:400:kworker.0 Request processed in 37us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725973.206923:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788725973.207181:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788725973.207424:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a111610700 x1875614935067776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725973.207436:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935067776:0@lo:400:kworker.0 00000100:00100000:3.0:1788725973.725879:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935067904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725973.725952:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725973.726031:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935067904 00000100:00100000:3.0:1788725973.726039:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935067904 00000100:00100000:3.0:1788725973.726084:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788725973.726094:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935067904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725973.726132:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788725973.726176:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935067904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725973.726184:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788725973.726243:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a111612d80 x1875614935067904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725973.726261:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935067904:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788725974.039484:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725974.749853:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935068032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725974.749929:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725974.751166:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935068032 00000100:00100000:2.0:1788725974.751177:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935068032 00000100:00100000:2.0:1788725974.751445:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788725974.751457:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935068032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788725974.751498:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788725974.753325:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935068032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1861us (3385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725974.753341:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788725974.758721:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a005961180 x1875614935068032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725974.758752:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935068032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788725975.061383:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725976.085491:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788725977.004434:0:10111:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:19:35 (1788725975) === 00010000:00010000:1.0:1788725977.109433:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725977.509328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725977.509430:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725977.509821:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914061440 00000100:00100000:0.0:1788725977.509832:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914061440 00000100:00100000:0.0:1788725977.509894:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 208 00000100:00100000:0.0:1788725977.509905:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:2352:x1875614914061440:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788725977.509985:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+10:2352:x1875614914061440:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 81us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725977.510007:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 208 00000100:00100000:1.0:1788725977.511156:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914061568 00000100:00100000:1.0:1788725977.511484:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914061568 00000100:00100000:1.0:1788725977.511658:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:1.0:1788725977.511669:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2352:x1875614914061568:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788725977.511749:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2352:x1875614914061568:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 82us (2431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725977.511757:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00080000:3.0:1788725977.512023:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725977.546025:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725977.547852:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914061696 00000100:00100000:1.0:1788725977.547868:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914061696 00000100:00100000:1.0:1788725977.547940:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 209 00000100:00100000:1.0:1788725977.547959:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+10:8117:x1875614914061696:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788725977.547976:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725977.547996:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a1398ea800/0xcbde9110e47c1146 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be90559f0e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725977.548027:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398ea800/0xcbde9110e47c1146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f0e expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725977.548037:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a1398ea800/0xcbde9110e47c1146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f0e expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725977.548047:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea800, rc 0) 00000100:00100000:1.0:1788725977.548113:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+11:8117:x1875614914061696:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 165us (2097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725977.548121:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 209 00000100:00100000:0.0:1788725977.566337:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725977.566441:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914061824 00000100:00100000:2.0:1788725977.566453:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914061824 00000100:00100000:2.0:1788725977.566509:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 210 00000100:00100000:2.0:1788725977.566519:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+11:8117:x1875614914061824:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788725977.567566:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+11:8117:x1875614914061824:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 1044us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725977.567577:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 210 00000100:00100000:3.0:1788725977.573280:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725977.573708:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914061952 00000100:00100000:1.0:1788725977.573719:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914061952 00000100:00100000:1.0:1788725977.573792:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 211 00000100:00100000:1.0:1788725977.573821:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+11:8117:x1875614914061952:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788725977.574147:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+11:8117:x1875614914061952:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 328us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725977.574155:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 211 00000100:00100000:0.0:1788725977.577585:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725977.577673:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914062080 00000100:00100000:2.0:1788725977.577684:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914062080 00000100:00100000:2.0:1788725977.577756:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 212 00000100:00100000:2.0:1788725977.577768:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+11:8121:x1875614914062080:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788725977.578357:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+11:8121:x1875614914062080:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 587us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725977.578367:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 212 00000100:00100000:2.0:1788725977.603788:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725977.603905:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914062208 00000100:00100000:0.0:1788725977.603915:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914062208 00000100:00100000:0.0:1788725977.603972:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 213 00000100:00100000:0.0:1788725977.603981:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+11:8121:x1875614914062208:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788725977.604281:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+11:8121:x1875614914062208:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 300us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725977.604290:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 213 00000100:00100000:3.0:1788725977.612433:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725977.615133:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914062336 00000100:00100000:2.0:1788725977.615151:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914062336 00000100:00100000:2.0:1788725977.615258:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 214 00000100:00100000:2.0:1788725977.615269:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+11:8117:x1875614914062336:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788725977.615288:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725977.615322:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e724200/0xcbde9110e47c114d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be90559f38 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725977.615354:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e724200/0xcbde9110e47c114d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f38 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725977.615367:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e724200/0xcbde9110e47c114d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f38 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725977.615377:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724200, rc 0) 00000100:00100000:2.0:1788725977.615450:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+12:8117:x1875614914062336:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 182us (3027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725977.615458:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 214 00000100:00100000:2.0:1788725977.625487:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725977.625688:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914062464 00000100:00100000:1.0:1788725977.625701:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914062464 00000100:00100000:1.0:1788725977.625764:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 215 00000100:00100000:1.0:1788725977.625776:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+12:8117:x1875614914062464:12345-192.168.201.42@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788725977.625803:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788725977.625840:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788725977.625844:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788725977.625847:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788725977.625850:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788725977.632870:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+12:8117:x1875614914062464:12345-192.168.201.42@tcp:256:mount.lustre.0 Request processed in 7074us (7371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725977.632885:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 215 00000100:00100000:3.0:1788725977.644154:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725977.644305:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914062592 00000100:00100000:1.0:1788725977.644317:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914062592 00000100:00100000:1.0:1788725977.644379:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 216 00000100:00100000:1.0:1788725977.644389:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+12:8117:x1875614914062592:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788725977.644406:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725977.644423:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c1154 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be90559f3f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725977.644450:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c1154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f3f expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725977.644479:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c1154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f3f expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725977.644489:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ebc00, rc 0) 00000100:00100000:1.0:1788725977.644551:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:8117:x1875614914062592:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 163us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725977.644559:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 216 00000100:00100000:2.0:1788725977.648197:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725977.648351:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914062720 00000100:00100000:1.0:1788725977.648361:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914062720 00000100:00100000:1.0:1788725977.648415:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 217 00000100:00100000:1.0:1788725977.648422:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:8117:x1875614914062720:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788725977.649308:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:8117:x1875614914062720:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 880us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725977.649318:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 217 00000100:00100000:3.0:1788725977.661014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725977.661172:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914062848 00000100:00100000:2.0:1788725977.661184:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914062848 00000100:00100000:2.0:1788725977.661280:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 218 00000100:00100000:2.0:1788725977.661291:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:8117:x1875614914062848:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788725977.661539:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:8117:x1875614914062848:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 249us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725977.661547:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 218 00000100:00100000:3.0:1788725977.671191:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725977.671503:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914062976 00000100:00100000:1.0:1788725977.671514:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914062976 00000100:00100000:1.0:1788725977.671579:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 219 00000100:00100000:1.0:1788725977.671588:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:8123:x1875614914062976:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788725977.671839:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:8123:x1875614914062976:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 251us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725977.671853:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 219 00000100:00100000:3.0:1788725977.678048:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725977.678206:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914063104 00000100:00100000:0.0:1788725977.678245:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914063104 00000100:00100000:0.0:1788725977.678304:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 220 00000100:00100000:0.0:1788725977.678314:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:8123:x1875614914063104:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788725977.678571:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:8123:x1875614914063104:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 257us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725977.678580:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 220 00000100:00100000:3.0:1788725977.693483:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725977.693691:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914063232 00000100:00100000:1.0:1788725977.693700:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914063232 00000100:00100000:1.0:1788725977.693744:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:1.0:1788725977.693751:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1875614914063232:12345-192.168.201.42@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788725977.693811:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a80b79b1-421f-4cd6-b6be-d8957417b61a@192.168.201.42@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:1.0:1788725977.693865:0:5834:0:(genops.c:1385:class_connect()) connect: client a80b79b1-421f-4cd6-b6be-d8957417b61a, cookie 0xcbde9110e47c115b 00000004:00100000:1.0:1788725977.693896:0:5834:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:1.0:1788725977.694169:0:5834:0:(import.c:65:import_set_state_nolock()) ffff91a141afb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788725977.694270:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:2348:x1875614914063232:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 518us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725977.694277:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788725977.703155:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725977.703477:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725977.703577:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914063360 00000100:00100000:2.0:1788725977.703587:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914063360 00000100:00100000:2.0:1788725977.703669:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914063488 00000100:00100000:2.0:1788725977.703673:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914063488 00000100:00100000:2.0:1788725977.703695:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:2.0:1788725977.703705:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+7:0:x1875614914063360:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788725977.703767:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788725977.703944:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:0.0:1788725977.703953:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+7:8117:x1875614914063488:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788725977.703966:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788725977.703992:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+7:8117:x1875614914063488:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 41us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725977.703999:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:2.0:1788725977.704108:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+7:0:x1875614914063360:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 144us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725977.704116:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00080000:3.0:1788725977.704336:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725977.713501:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725977.713668:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914063616 00000100:00100000:0.0:1788725977.713692:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914063616 00000100:00100000:0.0:1788725977.713756:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:0.0:1788725977.713766:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:8117:x1875614914063616:12345-192.168.201.42@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788725977.714001:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:8117:x1875614914063616:12345-192.168.201.42@tcp:40:mount.lustre.0 Request processed in 235us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725977.714009:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:3.0:1788725977.726938:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725977.726979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725977.727017:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725977.727099:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914064000 00000100:00100000:1.0:1788725977.727109:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914064000 00000100:00100000:1.0:1788725977.727171:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:1.0:1788725977.727182:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:8117:x1875614914064000:12345-192.168.201.42@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788725977.727296:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788725977.727382:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:8117:x1875614914064000:12345-192.168.201.42@tcp:33:mount.lustre.0 Request processed in 201us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725977.727390:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:2.0:1788725977.727575:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914063744 00000100:00100000:2.0:1788725977.727580:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914063744 00000100:00100000:2.0:1788725977.727610:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914063872 00000100:00100000:2.0:1788725977.727613:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914063872 00000100:00100000:2.0:1788725977.727633:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:2.0:1788725977.727649:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875614914063744:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788725977.727675:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a80b79b1-421f-4cd6-b6be-d8957417b61a@192.168.201.42@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:2.0:1788725977.727709:0:6680:0:(genops.c:1385:class_connect()) connect: client a80b79b1-421f-4cd6-b6be-d8957417b61a, cookie 0xcbde9110e47c1162 00002000:00100000:2.0:1788725977.727720:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a80b79b1-421f-4cd6-b6be-d8957417b61a/ffff91a13f447000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788725977.727746:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788725977.727999:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788725977.728028:0:6680:0:(import.c:65:import_set_state_nolock()) ffff91a13f443000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725977.728061:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:2348:x1875614914063744:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 421us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725977.728068:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:2.0:1788725977.728083:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:2.0:1788725977.728087:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875614914063872:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788725977.728100:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a80b79b1-421f-4cd6-b6be-d8957417b61a@192.168.201.42@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:2.0:1788725977.728115:0:6680:0:(genops.c:1385:class_connect()) connect: client a80b79b1-421f-4cd6-b6be-d8957417b61a, cookie 0xcbde9110e47c1169 00002000:00100000:2.0:1788725977.728120:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a80b79b1-421f-4cd6-b6be-d8957417b61a/ffff91a139f00000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788725977.728143:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788725977.728272:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788725977.728286:0:6680:0:(import.c:65:import_set_state_nolock()) ffff91a139f01800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725977.728307:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:2348:x1875614914063872:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 219us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725977.728314:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00010000:00010000:1.0:1788725978.133440:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725978.325625:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935068288:0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.325705:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725978.325762:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935068800:0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.325786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725978.325820:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788725978.325826:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935068160:0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.325862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725978.325893:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935068672:0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.325917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725978.325944:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935068416:0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.325967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725978.325985:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725978.325991:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935068544:0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.326024:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725978.326050:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935068288 00000100:00100000:3.0:1788725978.326067:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935068288 00000100:00100000:3.0:1788725978.326108:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935068672 00000100:00100000:3.0:1788725978.326111:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935068672 00000100:00100000:3.0:1788725978.326133:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935068544 00000100:00100000:3.0:1788725978.326136:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935068544 00000100:00100000:3.0:1788725978.326151:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788725978.326158:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935068288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.326207:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935068288:12345-0@lo:400:kworker.0 Request processed in 49us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725978.326242:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788725978.326259:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788725978.326265:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935068672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.326294:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935068672:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725978.326300:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788725978.326312:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788725978.326317:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935068544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.326345:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935068544:12345-0@lo:400:kworker.0 Request processed in 28us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725978.326351:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788725978.326367:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935068800 00000100:00100000:3.0:1788725978.326371:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935068800 00000100:00100000:3.0:1788725978.326396:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935068416 00000100:00100000:3.0:1788725978.326399:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935068416 00000100:00100000:3.0:1788725978.326418:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788725978.326425:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935068800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.326461:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935068800:12345-0@lo:400:kworker.0 Request processed in 36us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725978.326467:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788725978.326479:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788725978.326484:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935068416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.326509:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935068416:12345-0@lo:400:kworker.0 Request processed in 25us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725978.326515:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788725978.326668:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788725978.326671:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788725978.326674:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725978.326704:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935068544:0@lo:400:kworker.0 00010000:00080000:3.0:1788725978.326717:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13b17d180 x1875614935068416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725978.326727:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935068416:0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.326759:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935068672:0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.326769:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935068288:0@lo:400:kworker.0 00010000:00080000:3.0:1788725978.326778:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13b17f100 x1875614935068800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725978.326786:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935068800:0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.326810:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935068160 00000100:00100000:3.0:1788725978.326813:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935068160 00000100:00100000:3.0:1788725978.326834:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788725978.326839:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935068160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.326880:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935068160:12345-0@lo:400:kworker.0 Request processed in 40us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725978.326885:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788725978.326911:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935068160:0@lo:400:kworker.0 00000100:00100000:3.0:1788725978.837529:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725978.837551:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935068928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725978.837629:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725978.837697:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935068928 00000100:00100000:3.0:1788725978.837704:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935068928 00000100:00100000:3.0:1788725978.837747:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788725978.837755:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935068928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725978.837777:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788725978.837816:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935068928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725978.837822:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788725978.837857:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a111611c00 x1875614935068928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725978.837874:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935068928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788725979.162448:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725979.862483:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788725979.862507:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935069056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725979.862636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725979.862705:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935069056 00000100:00100000:0.0:1788725979.862713:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935069056 00000100:00100000:0.0:1788725979.862767:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788725979.862777:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935069056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788725979.862816:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788725979.863204:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935069056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 428us (568us total) trans 0 rc 0/0 00010000:00080000:2.0:1788725979.864314:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13b17d880 x1875614935069056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725979.864339:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935069056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725979.866876:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1788725980.183444:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725981.205452:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788725981.965443:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a80b79b1-421f-4cd6-b6be-d8957417b61a 00000001:00100000:0.0:1788725981.987367:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a80b79b1-421f-4cd6-b6be-d8957417b61a 00000001:00100000:3.0:1788725982.006817:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a80b79b1-421f-4cd6-b6be-d8957417b61a 00010000:00010000:1.0:1788725982.229544:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788725982.903991:0:10308:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1788725983.145789:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725983.145842:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725983.145891:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725983.145921:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725983.145951:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914064640 00000100:00100000:2.0:1788725983.145963:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914064640 00000100:00100000:3.0:1788725983.145978:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725983.146000:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914064384 00000100:00100000:3.0:1788725983.146003:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914064384 00000100:00100000:2.0:1788725983.146023:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914064512 00000100:00100000:2.0:1788725983.146026:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914064512 00000100:00100000:2.0:1788725983.146047:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:2.0:1788725983.146056:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914064640:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788725983.146082:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914064256 00000100:00100000:3.0:1788725983.146085:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914064256 00000100:00100000:3.0:1788725983.146104:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:3.0:1788725983.146110:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914064384:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788725983.146127:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914064640:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 71us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725983.146134:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:3.0:1788725983.146136:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914064384:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725983.146141:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:3.0:1788725983.146150:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:2.0:1788725983.146150:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:3.0:1788725983.146155:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914064256:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788725983.146156:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914064512:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788725983.146175:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914064256:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 19us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725983.146176:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914064512:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 21us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725983.146181:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:2.0:1788725983.146190:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00080000:2.0:1788725983.146203:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788725983.146208:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788725983.146209:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725983.146740:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914064128 00000100:00100000:1.0:1788725983.146745:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914064128 00000100:00100000:1.0:1788725983.146782:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 222 00000100:00100000:1.0:1788725983.146790:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:2350:x1875614914064128:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788725983.147023:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:2350:x1875614914064128:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 234us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725983.147031:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 222 00010000:00010000:3.0:1788725983.253368:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725983.445602:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935069568:0@lo:400:kworker.0 00000100:00100000:3.0:1788725983.445672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725983.445735:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725983.445741:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935069440:0@lo:400:kworker.0 00000100:00100000:3.0:1788725983.445776:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725983.445808:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935069440 00000100:00100000:3.0:1788725983.445816:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935069440 00000100:00100000:3.0:1788725983.445867:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788725983.445876:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935069440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725983.445924:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935069440:12345-0@lo:400:kworker.0 Request processed in 50us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725983.445944:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788725983.445966:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935069568 00000100:00100000:3.0:1788725983.445970:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935069568 00000100:00100000:3.0:1788725983.445994:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788725983.446000:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935069568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725983.446028:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935069568:12345-0@lo:400:kworker.0 Request processed in 29us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725983.446034:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1788725983.446062:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1111db100 x1875614935069440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725983.446076:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935069440:0@lo:400:kworker.0 00000100:00100000:3.0:1788725983.446086:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935069568:0@lo:400:kworker.0 00000100:00100000:1.0:1788725983.446291:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935069312:0@lo:400:kworker.0 00000100:00100000:1.0:1788725983.446323:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725983.446349:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935069824:0@lo:400:kworker.0 00000100:00100000:1.0:1788725983.446370:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725983.446394:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788725983.446400:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935069184:0@lo:400:kworker.0 00000100:00100000:1.0:1788725983.446425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725983.446447:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935069696:0@lo:400:kworker.0 00000100:00100000:1.0:1788725983.446467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725983.446493:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935069184 00000100:00100000:1.0:1788725983.446497:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935069184 00000100:00100000:1.0:1788725983.446525:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788725983.446531:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935069184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725983.446578:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935069184:12345-0@lo:400:kworker.0 Request processed in 48us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725983.446585:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788725983.446612:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935069312 00000100:00100000:1.0:1788725983.446616:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935069312 00000100:00100000:1.0:1788725983.446634:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935069696 00000100:00100000:1.0:1788725983.446637:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935069696 00000100:00100000:1.0:1788725983.446650:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788725983.446656:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935069312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725983.446682:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935069312:12345-0@lo:400:kworker.0 Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725983.446688:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788725983.446700:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788725983.446706:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935069696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725983.446740:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935069696:12345-0@lo:400:kworker.0 Request processed in 34us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725983.446746:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788725983.446774:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935069824 00000100:00100000:1.0:1788725983.446778:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935069824 00000100:00100000:1.0:1788725983.446802:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788725983.446808:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935069824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725983.446836:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935069824:12345-0@lo:400:kworker.0 Request processed in 29us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725983.446842:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788725983.446871:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935069184:0@lo:400:kworker.0 00000100:00100000:1.0:1788725983.446882:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935069696:0@lo:400:kworker.0 00000100:00100000:1.0:1788725983.446890:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935069312:0@lo:400:kworker.0 00010000:00080000:1.0:1788725983.446899:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1111d8a80 x1875614935069824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725983.446908:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935069824:0@lo:400:kworker.0 00000100:00080000:2.0:1788725983.447043:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788725983.447048:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788725983.447050:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725983.957469:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725983.957492:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935069952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725983.957596:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725983.958956:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935069952 00000100:00100000:0.0:1788725983.958968:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935069952 00000100:00100000:0.0:1788725983.959035:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788725983.959046:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935069952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788725983.959085:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788725983.959152:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935069952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725983.959160:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788725983.959205:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a9f7800 x1875614935069952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725983.959260:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935069952:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788725984.277373:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725984.988384:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935070080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725984.988444:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725984.988537:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935070080 00000100:00100000:2.0:1788725984.988545:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935070080 00000100:00100000:2.0:1788725984.988594:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788725984.988602:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935070080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788725984.988635:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788725984.988669:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935070080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725984.988674:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788725984.988743:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13b17d880 x1875614935070080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725984.988775:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935070080:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788725985.301393:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725986.325922:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725987.349352:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725988.263783:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725988.263838:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725988.263871:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725988.263893:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725988.264031:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914064768 00000100:00100000:3.0:1788725988.264041:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914064768 00000100:00100000:3.0:1788725988.264089:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 224 00000100:00100000:3.0:1788725988.264098:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:2349:x1875614914064768:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788725988.264162:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:2349:x1875614914064768:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 65us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725988.264169:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 224 00000100:00100000:1.0:1788725988.264746:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788725988.264774:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914065280 00000100:00100000:1.0:1788725988.264778:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914065280 00000100:00100000:1.0:1788725988.264815:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914065152 00000100:00100000:1.0:1788725988.264817:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914065152 00000100:00100000:1.0:1788725988.264835:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:1.0:1788725988.264844:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2349:x1875614914065280:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788725988.265238:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:3.0:1788725988.265254:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2349:x1875614914065152:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788725988.265296:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2349:x1875614914065152:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 44us (551us total) trans 0 rc 0/0 00000100:00080000:0.0:1788725988.265298:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788725988.265302:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788725988.265303:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:0.0:1788725988.265317:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914065024 00000100:00100000:0.0:1788725988.265322:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914065024 00000100:00080000:3.0:1788725988.265349:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725988.265355:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914064896 00000100:00100000:0.0:1788725988.265359:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914064896 00000100:00100000:0.0:1788725988.265397:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:0.0:1788725988.265405:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2349:x1875614914065024:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788725988.265434:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2349:x1875614914065024:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 30us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725988.265440:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:0.0:1788725988.265451:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:0.0:1788725988.265456:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914064896:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788725988.265488:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914064896:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725988.265494:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00080000:3.0:1788725988.268357:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725988.268515:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2349:x1875614914065280:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 3666us (4636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725988.268528:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00010000:00010000:3.0:1788725988.374371:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725988.565870:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935070592:0@lo:400:kworker.0 00000100:00100000:3.0:1788725988.565945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725988.566004:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725988.566011:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935070464:0@lo:400:kworker.0 00000100:00100000:3.0:1788725988.566035:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725988.566067:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935070592 00000100:00100000:3.0:1788725988.566073:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935070592 00000100:00100000:3.0:1788725988.566143:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788725988.566152:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935070208:0@lo:400:kworker.0 00000100:00100000:3.0:1788725988.566164:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935070592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725988.566197:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725988.566258:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935070592:12345-0@lo:400:kworker.0 Request processed in 106us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725988.566261:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935070720:0@lo:400:kworker.0 00000100:00100000:3.0:1788725988.566272:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788725988.566294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725988.566300:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935070464 00000100:00100000:3.0:1788725988.566306:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935070464 00000100:00100000:0.0:1788725988.566322:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788725988.566329:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935070336:0@lo:400:kworker.0 00000100:00100000:3.0:1788725988.566340:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788725988.566351:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935070464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725988.566358:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725988.566425:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935070720 00000100:00100000:2.0:1788725988.566430:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935070720 00000100:00100000:2.0:1788725988.566473:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935070336 00000100:00100000:2.0:1788725988.566477:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935070336 00000100:00100000:2.0:1788725988.566493:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788725988.566500:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935070720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725988.566573:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788725988.566582:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935070336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725988.566682:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935070464:12345-0@lo:400:kworker.0 Request processed in 333us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725988.566688:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788725988.566727:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935070848:0@lo:400:kworker.0 00000100:00100000:0.0:1788725988.566753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725988.566782:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935070208 00000100:00100000:0.0:1788725988.566785:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935070208 00000100:00080000:3.0:1788725988.566840:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788725988.566846:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725988.576688:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935070720:12345-0@lo:400:kworker.0 Request processed in 10178us (10385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725988.576704:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788725988.576933:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935070720:0@lo:400:kworker.0 00000100:00100000:0.0:1788725988.576970:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935070848 00000100:00100000:0.0:1788725988.576977:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935070848 00000100:00100000:0.0:1788725988.577036:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788725988.577046:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935070848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725988.577109:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935070848:12345-0@lo:400:kworker.0 Request processed in 65us (10355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725988.577115:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788725988.577147:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a141d31c00 x1875614935070848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725988.577157:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935070848:0@lo:400:kworker.0 00000100:00100000:0.0:1788725988.577179:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788725988.577187:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935070208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725988.577246:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935070208:12345-0@lo:400:kworker.0 Request processed in 59us (11048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725988.577252:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788725988.577276:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935070208:0@lo:400:kworker.0 00010000:00080000:3.0:1788725988.582307:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1111d8a80 x1875614935070464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725988.582327:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935070464:0@lo:400:kworker.0 00000100:00100000:3.0:1788725988.582341:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935070592:0@lo:400:kworker.0 00000100:00080000:3.0:1788725988.582387:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725988.587250:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935070336:12345-0@lo:400:kworker.0 Request processed in 20658us (20881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725988.587268:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788725988.587420:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935070336:0@lo:400:kworker.0 00000100:00100000:1.0:1788725989.077558:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935070976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725989.077632:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725989.077724:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935070976 00000100:00100000:3.0:1788725989.077733:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935070976 00000100:00100000:3.0:1788725989.077788:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788725989.077798:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935070976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725989.077837:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788725989.078180:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935070976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 382us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725989.078189:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788725989.081063:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a9f4000 x1875614935070976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725989.081088:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935070976:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788725989.399133:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725990.101584:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935071104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788725990.101678:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725990.101907:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935071104 00000100:00100000:2.0:1788725990.101917:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935071104 00000100:00100000:2.0:1788725990.101984:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788725990.102008:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935071104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788725990.102044:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788725990.102093:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935071104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725990.102100:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788725990.102137:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13b17f100 x1875614935071104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725990.102156:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935071104:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788725990.102420:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788725990.426606:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725991.445467:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725992.471492:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725993.382509:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725993.382554:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725993.382669:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914065408 00000100:00100000:2.0:1788725993.382680:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914065408 00000100:00100000:2.0:1788725993.382731:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 226 00000100:00100000:2.0:1788725993.382742:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2352:x1875614914065408:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788725993.382810:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2352:x1875614914065408:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 69us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725993.382817:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 226 00000100:00100000:3.0:1788725993.383193:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914065536 00000100:00100000:3.0:1788725993.383198:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914065536 00000100:00100000:3.0:1788725993.383260:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:3.0:1788725993.383268:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2352:x1875614914065536:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788725993.383356:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2352:x1875614914065536:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 87us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725993.383363:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00080000:3.0:1788725993.383392:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725993.383439:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725993.383517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725993.383538:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914065664 00000100:00100000:2.0:1788725993.383542:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914065664 00000100:00100000:2.0:1788725993.383571:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:2.0:1788725993.383578:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2352:x1875614914065664:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788725993.383618:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2352:x1875614914065664:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 40us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725993.383625:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:3.0:1788725993.384208:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914065792 00000100:00100000:3.0:1788725993.384508:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914065792 00000100:00100000:3.0:1788725993.384552:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:3.0:1788725993.384560:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2352:x1875614914065792:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788725993.384722:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2352:x1875614914065792:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 162us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725993.384730:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00080000:3.0:1788725993.384748:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788725993.384752:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725993.384806:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788725993.385260:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914065920 00000100:00100000:2.0:1788725993.385266:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914065920 00000100:00100000:2.0:1788725993.385299:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:2.0:1788725993.385306:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2351:x1875614914065920:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788725993.385339:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2351:x1875614914065920:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 34us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725993.385345:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00080000:3.0:1788725993.385848:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788725993.494359:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725993.685475:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788725993.690857:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935071360:0@lo:400:kworker.0 00000100:00100000:1.0:1788725993.692141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725993.692295:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935071232:0@lo:400:kworker.0 00000100:00100000:1.0:1788725993.692338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725993.692410:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935071360 00000100:00100000:2.0:1788725993.692420:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935071360 00000100:00100000:2.0:1788725993.692482:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788725993.692492:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935071360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725993.692553:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935071360:12345-0@lo:400:kworker.0 Request processed in 63us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725993.692560:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788725993.693146:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935071488:0@lo:400:kworker.0 00000100:00100000:3.0:1788725993.693180:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725993.693244:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935071616:0@lo:400:kworker.0 00000100:00100000:2.0:1788725993.693272:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725993.694777:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935071232 00000100:00100000:0.0:1788725993.694790:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935071232 00000100:00100000:0.0:1788725993.694863:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788725993.694873:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935071232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725993.694940:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935071232:12345-0@lo:400:kworker.0 Request processed in 68us (2601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725993.694946:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788725993.695006:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935071744:0@lo:400:kworker.0 00000100:00100000:0.0:1788725993.695040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725993.695139:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935071232:0@lo:400:kworker.0 00000100:00100000:1.0:1788725993.695167:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935071872:0@lo:400:kworker.0 00000100:00100000:1.0:1788725993.695194:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725993.695243:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935071360:0@lo:400:kworker.0 00000100:00100000:1.0:1788725993.695289:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935071616 00000100:00100000:1.0:1788725993.695293:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935071616 00000100:00100000:1.0:1788725993.695329:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935071744 00000100:00100000:1.0:1788725993.695333:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935071744 00000100:00100000:1.0:1788725993.695355:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788725993.695361:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935071616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725993.695410:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935071616:12345-0@lo:400:kworker.0 Request processed in 48us (2136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725993.695416:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788725993.695428:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788725993.695434:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935071744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725993.695463:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935071744:12345-0@lo:400:kworker.0 Request processed in 30us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725993.695469:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788725993.695485:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725993.695523:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935071488 00000100:00100000:1.0:1788725993.695527:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935071488 00000100:00100000:1.0:1788725993.695554:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935071872 00000100:00100000:1.0:1788725993.695571:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935071872 00000100:00100000:1.0:1788725993.695774:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788725993.695780:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935071488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725993.695816:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935071488:12345-0@lo:400:kworker.0 Request processed in 38us (2636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725993.695822:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788725993.695832:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788725993.695838:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935071872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725993.695866:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935071872:12345-0@lo:400:kworker.0 Request processed in 28us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725993.695871:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788725993.695885:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788725993.695887:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788725993.695906:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a9c7800 x1875614935071872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725993.695917:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935071872:0@lo:400:kworker.0 00010000:00080000:3.0:1788725993.696275:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a9c4a80 x1875614935071488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725993.696286:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935071488:0@lo:400:kworker.0 00000100:00100000:2.0:1788725993.698600:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935071616:0@lo:400:kworker.0 00000100:00100000:0.0:1788725993.701385:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935071744:0@lo:400:kworker.0 00000100:00100000:1.0:1788725994.197386:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788725994.197409:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935072000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725994.197483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725994.197547:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935072000 00000100:00100000:1.0:1788725994.197553:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935072000 00000100:00100000:1.0:1788725994.197607:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788725994.197615:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935072000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788725994.197659:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788725994.197699:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935072000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725994.197706:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788725994.197750:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a139865880 x1875614935072000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725994.197767:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935072000:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788725994.517811:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725995.229745:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725995.229769:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935072128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788725995.229838:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725995.229897:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935072128 00000100:00100000:3.0:1788725995.229905:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935072128 00000100:00100000:3.0:1788725995.229959:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788725995.229977:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935072128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788725995.230015:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788725995.230055:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935072128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725995.230061:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788725995.230080:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788725995.230106:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a9c4a80 x1875614935072128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725995.230123:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935072128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788725995.548474:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725996.565354:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725997.589390:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788725998.256742:0:11009:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788725998.505797:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725998.505927:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725998.514251:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725998.514307:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788725998.514353:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788725998.514510:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914066048 00000100:00100000:0.0:1788725998.514520:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914066048 00000100:00100000:0.0:1788725998.514583:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 228 00000100:00100000:0.0:1788725998.514595:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:2350:x1875614914066048:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788725998.514670:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:2350:x1875614914066048:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 77us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725998.514678:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 228 00000100:00100000:1.0:1788725998.515192:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914066432 00000100:00100000:1.0:1788725998.515199:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914066432 00000100:00100000:0.0:1788725998.515311:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914066304 00000100:00100000:0.0:1788725998.515316:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914066304 00000100:00100000:1.0:1788725998.520895:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914066560 00000100:00100000:1.0:1788725998.520911:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914066560 00000100:00100000:0.0:1788725998.521003:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914066176 00000100:00100000:0.0:1788725998.521008:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914066176 00000100:00100000:0.0:1788725998.521047:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:0.0:1788725998.521057:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914066304:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788725998.521153:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914066304:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 97us (6845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725998.521160:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:0.0:1788725998.521177:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:0.0:1788725998.521183:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914066176:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788725998.521238:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914066176:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 55us (6885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725998.521245:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:0.0:1788725998.522424:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:0.0:1788725998.522443:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2348:x1875614914066432:12345-192.168.201.42@tcp:9:kworker.0 00000020:00000080:0.0:1788725998.522469:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c1162 00000100:00080000:0.0:1788725998.522482:0:6683:0:(import.c:65:import_set_state_nolock()) ffff91a13f443000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788725998.522526:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1788725998.523647:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725998.524787:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+2:2348:x1875614914066432:12345-192.168.201.42@tcp:9:kworker.0 Request processed in 2343us (18988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725998.524802:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00080000:3.0:1788725998.525000:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788725998.525210:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725998.531741:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:1.0:1788725998.531760:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2348:x1875614914066560:12345-192.168.201.42@tcp:9:kworker.0 00000020:00000080:1.0:1788725998.531792:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c1169 00000100:00080000:1.0:1788725998.531803:0:6680:0:(import.c:65:import_set_state_nolock()) ffff91a139f01800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788725998.531921:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:2.0:1788725998.532369:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725998.535683:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+2:2348:x1875614914066560:12345-192.168.201.42@tcp:9:kworker.0 Request processed in 3916us (29741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725998.535698:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00010000:00010000:0.0:1788725998.546406:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725998.613870:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725998.806671:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935072512:0@lo:400:kworker.0 00000100:00100000:3.0:1788725998.806745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725998.806823:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725998.806830:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935072640:0@lo:400:kworker.0 00000100:00100000:3.0:1788725998.806856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725998.806890:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935072640 00000100:00100000:3.0:1788725998.806897:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935072640 00000100:00100000:3.0:1788725998.806952:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788725998.806961:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935072640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725998.807025:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935072640:12345-0@lo:400:kworker.0 Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725998.807033:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788725998.807079:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935072640:0@lo:400:kworker.0 00000100:00100000:2.0:1788725998.807295:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935072256:0@lo:400:kworker.0 00000100:00100000:2.0:1788725998.807329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725998.807356:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935072768:0@lo:400:kworker.0 00000100:00100000:2.0:1788725998.807387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725998.807410:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788725998.807415:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935072384:0@lo:400:kworker.0 00000100:00100000:2.0:1788725998.807436:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725998.807451:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935072896:0@lo:400:kworker.0 00000100:00100000:2.0:1788725998.807472:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725998.807501:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935072768 00000100:00100000:2.0:1788725998.807506:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935072768 00000100:00100000:2.0:1788725998.807543:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935072384 00000100:00100000:2.0:1788725998.807547:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935072384 00000100:00100000:2.0:1788725998.807562:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788725998.807568:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935072768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725998.807605:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935072768:12345-0@lo:400:kworker.0 Request processed in 37us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725998.807612:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788725998.807625:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788725998.807630:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935072384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725998.807658:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935072384:12345-0@lo:400:kworker.0 Request processed in 28us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725998.807664:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788725998.807680:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935072256 00000100:00100000:2.0:1788725998.807683:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935072256 00000100:00100000:2.0:1788725998.807706:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788725998.807712:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935072256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725998.807739:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935072256:12345-0@lo:400:kworker.0 Request processed in 28us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725998.807754:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788725998.807809:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935072384:0@lo:400:kworker.0 00000100:00100000:2.0:1788725998.807820:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935072256:0@lo:400:kworker.0 00000100:00100000:2.0:1788725998.807829:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935072768:0@lo:400:kworker.0 00000100:00100000:2.0:1788725998.807868:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935072512 00000100:00100000:2.0:1788725998.807871:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935072512 00000100:00080000:1.0:1788725998.808421:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788725998.808428:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725998.808505:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935072896 00000100:00100000:2.0:1788725998.808511:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935072896 00000100:00100000:0.0:1788725998.808603:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788725998.808617:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935072512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725998.808675:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935072512:12345-0@lo:400:kworker.0 Request processed in 63us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725998.808682:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788725998.808789:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a9f5180 x1875614935072512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725998.808804:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935072512:0@lo:400:kworker.0 00000100:00100000:2.0:1788725998.809413:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788725998.809422:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935072896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725998.809476:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935072896:12345-0@lo:400:kworker.0 Request processed in 55us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725998.809482:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788725998.809512:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a9f5880 x1875614935072896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725998.809898:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935072896:0@lo:400:kworker.0 00000100:00080000:1.0:1788725998.810103:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788725999.317992:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725999.318019:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935073024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725999.318092:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725999.318168:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935073024 00000100:00100000:3.0:1788725999.318176:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935073024 00000100:00100000:3.0:1788725999.318242:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788725999.319902:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935073024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725999.319948:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788725999.320035:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935073024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (1942us total) trans 0 rc 0/0 00010000:00080000:2.0:1788725999.320145:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a005960a80 x1875614935073024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725999.320165:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935073024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725999.321353:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788725999.638633:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726000.341516:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788726000.341542:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935073152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788726000.341614:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726000.341954:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935073152 00000100:00100000:2.0:1788726000.341963:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935073152 00000100:00080000:1.0:1788726000.342175:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788726000.342293:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788726000.342305:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139865880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935073152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788726000.342351:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788726000.342411:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139865880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935073152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (797us total) trans 0 rc 0/0 00010000:00080000:1.0:1788726000.342475:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13b17c380 x1875614935073152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726000.342495:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935073152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788726000.345691:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1788726000.667140:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726001.690374:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788726001.798190:0:11156:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff951a4770 20000000:00000080:0.0:1788726001.798210:0:11156:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91a0052b2400 uarg=0000000000000000 20000000:01000000:0.0:1788726001.798475:0:11156:0:(mgs_llog.c:6195:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788726001.798481:0:11156:0:(mgs_llog.c:4650:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788726001.798486:0:11156:0:(mgs_llog.c:1382:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788726001.799527:0:11157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788726001.799785:0:11156:0:(mgs_llog.c:1453:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788726001.806666:0:11156:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788726001.806697:0:11156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a100031000/0xcbde9110e47c1170 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.806718:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10db71a00/0xcbde9110e47c1115 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f07 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.806742:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10db71e00/0xcbde9110e47c1123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c111c expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.806750:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10db70600/0xcbde9110e47c1131 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c112a expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.806882:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10e724600/0xcbde9110e47c113f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c1138 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.806890:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c1154 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f3f expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.806898:0:11156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a100031000/0xcbde9110e47c1170 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.806945:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c1154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f3f expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.806962:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c1154 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f3f expref: 12 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726001.806978:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1875614935073280:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726001.807130:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10e724600/0xcbde9110e47c113f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c1138 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.807139:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a10e724600/0xcbde9110e47c113f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c1138 expref: 18 pid: 5827 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726001.807149:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1875614935073408:0@lo:104: 00000100:00100000:0.0:1788726001.807194:0:11156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788726001.807276:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10db70600/0xcbde9110e47c1131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c112a expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.807284:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a10db70600/0xcbde9110e47c1131 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c112a expref: 18 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726001.807293:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1875614935073536:0@lo:104: 00000100:00100000:0.0:1788726001.807314:0:11156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726001.807344:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935073408 00000100:00100000:0.0:1788726001.807352:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935073408 00000100:00100000:0.0:1788726001.807388:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935073536 00000100:00100000:0.0:1788726001.807391:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935073536 00000100:00100000:0.0:1788726001.807407:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788726001.807415:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+4:11156:x1875614935073408:12345-0@lo:104: 00010000:00010000:0.0:1788726001.807427:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c1138 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c113f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.807483:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788726001.807645:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+4:11156:x1875614935073408:12345-0@lo:104: Request processed in 75us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726001.807652:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788726001.807670:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788726001.807677:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:11156:x1875614935073536:12345-0@lo:104: 00010000:00010000:0.0:1788726001.807684:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10e725200/0xcbde9110e47c112a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c1131 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.807763:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788726001.807769:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:11156:x1875614935073536:12345-0@lo:104: Request processed in 93us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726001.807782:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788726001.807815:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10db71e00/0xcbde9110e47c1123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c111c expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.807825:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a10db71e00/0xcbde9110e47c1123 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c111c expref: 18 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726001.807833:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1875614935073664:0@lo:104: 00000100:00100000:0.0:1788726001.807856:0:11156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788726001.807883:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10db71a00/0xcbde9110e47c1115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f07 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.807893:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a10db71a00/0xcbde9110e47c1115 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f07 expref: 12 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726001.807901:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1875614935073792:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726001.807925:0:11156:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1068f3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788726001.807946:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1875614935073408:0@lo:104: 00000100:00100000:0.0:1788726001.807954:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1875614935073536:0@lo:104: 00000100:00100000:0.0:1788726001.808638:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935073664 00000100:00100000:0.0:1788726001.808646:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935073664 00000100:00100000:0.0:1788726001.808673:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788726001.808680:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:11156:x1875614935073664:12345-0@lo:104: 00010000:00010000:0.0:1788726001.808690:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10e724c00/0xcbde9110e47c111c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c1123 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.808929:0:8494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788726001.808936:0:8494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c1138 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c113f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.808944:0:8494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725400 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:1.0:1788726001.808947:0:8494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c1138 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c113f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.808955:0:8494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c1138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c113f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788726001.808963:0:8494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c1138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c113f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726001.808969:0:8494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788726001.809006:0:8494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c1138 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c113f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.809013:0:8494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788726001.809035:0:8494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c1138 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c113f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.809042:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e725400/0xcbde9110e47c1138 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c113f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.809064:0:8494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788726001.809067:0:8494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e725200/0xcbde9110e47c112a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c1131 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.809073:0:8494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725200 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:1.0:1788726001.809076:0:8494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725200/0xcbde9110e47c112a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c1131 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.809083:0:8494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e725200/0xcbde9110e47c112a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c1131 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788726001.809089:0:8494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725200/0xcbde9110e47c112a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c1131 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726001.809094:0:8494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788726001.809108:0:8494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e725200/0xcbde9110e47c112a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c1131 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.809114:0:8494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788726001.809120:0:8494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e725200/0xcbde9110e47c112a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c1131 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.809126:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e725200/0xcbde9110e47c112a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c1131 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.809134:0:8494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726001.809137:0:8494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e724c00/0xcbde9110e47c111c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c1123 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.809152:0:8494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724c00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:1.0:1788726001.809155:0:8494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724c00/0xcbde9110e47c111c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c1123 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.809161:0:8494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e724c00/0xcbde9110e47c111c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c1123 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788726001.809168:0:8494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724c00/0xcbde9110e47c111c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c1123 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726001.809173:0:8494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788726001.809187:0:8494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e724c00/0xcbde9110e47c111c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c1123 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.809193:0:8494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788726001.809207:0:8494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e724c00/0xcbde9110e47c111c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c1123 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.809363:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e724c00/0xcbde9110e47c111c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c1123 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.809377:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726001.809379:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726001.809380:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726001.809393:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935073920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788726001.809429:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726001.809467:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788726001.809473:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935074048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788726001.810745:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726001.810808:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935074176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788726001.810841:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726001.810882:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935073920 00000100:00100000:1.0:1788726001.810889:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935073920 00010000:00010000:1.0:1788726001.810918:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10e724600/0xcbde9110e47c113f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c1138 expref: 19 pid: 5827 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726001.810942:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935074048 00000100:00100000:1.0:1788726001.810944:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935074048 00010000:00010000:1.0:1788726001.810953:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10db70600/0xcbde9110e47c1131 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c112a expref: 20 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726001.810968:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935074176 00000100:00100000:1.0:1788726001.810970:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935074176 00010000:00010000:1.0:1788726001.810979:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10db71e00/0xcbde9110e47c1123 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c111c expref: 21 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726001.810992:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788726001.810999:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+21:3304:x1875614935073920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788726001.811012:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726001.811017:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10e724600/0xcbde9110e47c113f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c1138 expref: 21 pid: 5827 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.811026:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10e724600/0xcbde9110e47c113f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c1138 expref: 21 pid: 5827 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.811040:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e724600/0xcbde9110e47c113f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c1138 expref: 21 pid: 5827 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.811074:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726001.811107:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+20:3304:x1875614935073920:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726001.811114:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788726001.811131:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788726001.811136:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1202a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935074048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788726001.811143:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726001.811147:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10db70600/0xcbde9110e47c1131 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c112a expref: 19 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.811156:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10db70600/0xcbde9110e47c1131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c112a expref: 19 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.811165:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10db70600/0xcbde9110e47c1131 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c112a expref: 19 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.811176:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726001.811198:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1202a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:3304:x1875614935074048:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726001.811204:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788726001.811275:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788726001.811282:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:3306:x1875614935074176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788726001.811289:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726001.811293:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10db71e00/0xcbde9110e47c1123 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c111c expref: 17 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.811301:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10db71e00/0xcbde9110e47c1123 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c111c expref: 17 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.811317:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726001.811341:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:3306:x1875614935074176:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726001.811347:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788726001.811382:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935074048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788726001.811389:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935073920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788726001.811409:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935074176:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788726001.814245:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726001.814301:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788726001.814334:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:11156:x1875614935073664:12345-0@lo:104: Request processed in 5650us (6472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726001.814346:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1788726001.814418:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10db71e00/0xcbde9110e47c1123 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c111c expref: 16 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726001.814432:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1875614935073664:0@lo:104: 00000100:00100000:1.0:1788726001.814774:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726001.814806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726001.814808:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914066688 00000100:00100000:3.0:1788726001.814815:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914066688 00000100:00100000:1.0:1788726001.814826:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914066816 00000100:00100000:1.0:1788726001.814828:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914066816 00010000:00010000:1.0:1788726001.814846:0:8495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10db71a00/0xcbde9110e47c1115 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f07 expref: 14 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726001.814847:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c1154 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f3f expref: 14 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726001.814902:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1875614935073280:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726001.814911:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1875614935073792:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726001.814939:0:11156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a100031000/0xcbde9110e47c1170 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726001.814980:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:1.0:1788726001.814989:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111615500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2306ca11-4668-43b2-bddf-879669734d27+14:2349:x1875614914066816:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726001.815002:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726001.815008:0:8495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10db71a00/0xcbde9110e47c1115 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f07 expref: 14 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.815019:0:8495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10db71a00/0xcbde9110e47c1115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f07 expref: 14 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.815034:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10db71a00/0xcbde9110e47c1115 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f07 expref: 14 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.815055:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726001.815104:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111615500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2306ca11-4668-43b2-bddf-879669734d27+13:2349:x1875614914066816:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 116us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726001.815111:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:1.0:1788726001.815125:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:1.0:1788726001.815130:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2306ca11-4668-43b2-bddf-879669734d27+12:2349:x1875614914066688:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726001.815137:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726001.815141:0:8495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c1154 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f3f expref: 12 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.815151:0:8495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c1154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f3f expref: 12 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.815160:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c1154 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f3f expref: 12 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.815171:0:8495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a100031000/0xcbde9110e47c1170 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.815179:0:8495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a100031000/0xcbde9110e47c1170 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.815192:0:8495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a100031000/0xcbde9110e47c1170 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.815198:0:8495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a100031000/0xcbde9110e47c1170 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.815248:0:8495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a100031000/0xcbde9110e47c1170 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.815256:0:8495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a100031000/0xcbde9110e47c1170 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.815262:0:8495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031000 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726001.815267:0:8495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a100031000/0xcbde9110e47c1170 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.815274:0:8495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a100031000/0xcbde9110e47c1170 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.815284:0:8495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a100031000/0xcbde9110e47c1170 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726001.815292:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726001.815319:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2306ca11-4668-43b2-bddf-879669734d27+11:2349:x1875614914066688:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 188us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726001.815326:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00010000:00010000:0.0:1788726001.815707:0:11156:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a100031000/0xcbde9110e47c1170 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.815715:0:11156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a100031000/0xcbde9110e47c1170 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726001.815721:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100031000/0xcbde9110e47c1170 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726001.817613:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788726002.488593:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a80b79b1-421f-4cd6-b6be-d8957417b61a 00000020:00000080:2.0:1788726002.488605:0:6711:0:(genops.c:885:class_export_put()) final put ffff91a13f447000/a80b79b1-421f-4cd6-b6be-d8957417b61a 00000020:00000080:2.0:1788726002.488635:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13f447000/a80b79b1-421f-4cd6-b6be-d8957417b61a for lustre-OST0000 00000020:00000080:2.0:1788726002.488679:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a13f443000 for lustre-OST0000 00000001:00100000:3.0:1788726002.511184:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a80b79b1-421f-4cd6-b6be-d8957417b61a 00000020:00000080:3.0:1788726002.511193:0:7632:0:(genops.c:885:class_export_put()) final put ffff91a139f00000/a80b79b1-421f-4cd6-b6be-d8957417b61a 00000020:00000080:3.0:1788726002.511363:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91a139f00000/a80b79b1-421f-4cd6-b6be-d8957417b61a for lustre-OST0001 00000020:00000080:3.0:1788726002.511408:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a139f01800 for lustre-OST0001 00010000:00010000:1.0:1788726002.709478:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788726003.288326:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788726003.288333:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a13adc2000 from 7 10000000:01000000:2.0:1788726003.288338:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788726003.288380:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725000/0xcbde9110e47c1177 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.288403:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10e725000/0xcbde9110e47c1177 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.288422:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e725000/0xcbde9110e47c1177 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726003.288448:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935074304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788726003.288527:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726003.288597:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13a493900 going to sleep for 11 seconds 00000100:00100000:1.0:1788726003.288711:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935074304 00000100:00100000:1.0:1788726003.288720:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935074304 00000100:00100000:1.0:1788726003.288775:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788726003.288786:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935074304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788726003.288809:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726003.288824:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c117e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c1177 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726003.288861:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c117e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c1177 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726003.288870:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c117e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c1177 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726003.288880:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ebc00, rc 0) 00000100:00100000:1.0:1788726003.288925:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935074304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726003.288932:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788726003.288981:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935074304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788726003.288996:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e725000/0xcbde9110e47c1177 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c117e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726003.289004:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e725000/0xcbde9110e47c1177 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c117e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726003.289059:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935074432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788726003.289086:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726003.289097:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1067f9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788726003.289563:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935074432 00000100:00100000:2.0:1788726003.289569:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935074432 00000100:00100000:2.0:1788726003.289601:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788726003.289617:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935074432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788726003.290023:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935074432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 406us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726003.290031:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788726003.290103:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935074432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788726003.290135:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935074560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788726003.290175:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726003.290200:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1067f9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788726003.290278:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935074560 00000100:00100000:2.0:1788726003.290283:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935074560 00000100:00100000:2.0:1788726003.290315:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788726003.290322:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935074560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788726003.290504:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935074560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726003.290511:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788726003.290628:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935074560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788726003.314731:0:11190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788726003.322435:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788726003.322486:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788726003.322498:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725000/0xcbde9110e47c1177 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c117e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.322512:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e725000/0xcbde9110e47c1177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c117e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726003.322523:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788726003.322525:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a10338f800 from 7 10000000:01000000:2.0:1788726003.322528:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788726003.322578:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c1185 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.322587:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c1185 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.322598:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c1185 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726003.322639:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935074688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788726003.322711:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726003.322762:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13a4939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726003.322928:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935074688 00000100:00100000:1.0:1788726003.322936:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935074688 00000100:00100000:1.0:1788726003.322991:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788726003.323002:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935074688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788726003.323016:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726003.323029:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a1398eb200/0xcbde9110e47c118c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c1185 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726003.323051:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398eb200/0xcbde9110e47c118c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c1185 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726003.323062:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a1398eb200/0xcbde9110e47c118c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c1185 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726003.323070:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eb200, rc 0) 00000100:00100000:1.0:1788726003.323111:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935074688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726003.323117:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788726003.323570:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935074688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726003.323586:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c1185 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c118c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.323596:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c1185 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c118c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726003.323648:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935074816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788726003.323676:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726003.323699:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13a4939c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726003.323714:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935074816 00000100:00100000:2.0:1788726003.323717:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935074816 00000100:00100000:2.0:1788726003.323743:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788726003.323750:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935074816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788726003.324199:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935074816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 448us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726003.324233:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788726003.330703:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935074816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788726003.330843:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935074944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788726003.330922:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726003.330967:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1068f39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726003.331079:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935074944 00000100:00100000:1.0:1788726003.331086:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935074944 00000100:00100000:1.0:1788726003.331143:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788726003.331152:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935074944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788726003.331384:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935074944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726003.331404:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788726003.332334:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935074944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788726003.333414:0:11192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788726003.333891:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788726003.333909:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788726003.333921:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c1185 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c118c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726003.333933:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c1185 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c118c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726003.333944:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788726003.333946:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a120292000 from 7 10000000:01000000:1.0:1788726003.333949:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788726003.333984:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a1398eb800/0xcbde9110e47c1193 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726003.333993:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a1398eb800/0xcbde9110e47c1193 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726003.334004:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a1398eb800/0xcbde9110e47c1193 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726003.334025:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935075072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788726003.334082:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726003.334160:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1067f9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788726003.342283:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935075072 00000100:00100000:2.0:1788726003.342302:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935075072 00000100:00100000:2.0:1788726003.342365:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788726003.342381:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935075072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726003.342407:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726003.342443:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c119a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c1193 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.342481:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c119a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c1193 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.342494:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c119a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c1193 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.342503:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724c00, rc 0) 00000100:00100000:2.0:1788726003.342589:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935075072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (8507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726003.342596:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788726003.344808:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935075072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788726003.344839:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a1398eb800/0xcbde9110e47c1193 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c119a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726003.344853:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a1398eb800/0xcbde9110e47c1193 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c119a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726003.344956:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935075200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788726003.345016:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726003.345065:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1067f9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788726003.345762:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935075200 00000100:00100000:2.0:1788726003.345771:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935075200 00000100:00100000:2.0:1788726003.345846:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788726003.345858:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935075200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788726003.346141:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935075200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726003.346149:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788726003.346354:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935075200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788726003.346393:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935075328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788726003.346446:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726003.346479:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1067f9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788726003.347509:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935075328 00000100:00100000:2.0:1788726003.347518:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935075328 00000100:00100000:2.0:1788726003.347916:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788726003.347929:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935075328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788726003.348155:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935075328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 229us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726003.348164:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788726003.348470:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111617b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935075328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788726003.350132:0:11193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788726003.350367:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788726003.350426:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788726003.350440:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a1398eb800/0xcbde9110e47c1193 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c119a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.350451:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a1398eb800/0xcbde9110e47c1193 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c119a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726003.510273:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726003.513855:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914066944 00000100:00100000:2.0:1788726003.513870:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914066944 00000100:00100000:2.0:1788726003.513944:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 239 00000100:00100000:2.0:1788726003.513958:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+11:5593:x1875614914066944:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726003.513975:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726003.513994:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e725200/0xcbde9110e47c11a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be90559f69 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.514023:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e725200/0xcbde9110e47c11a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f69 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.514035:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e725200/0xcbde9110e47c11a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f69 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.514045:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725200, rc 0) 00000100:00100000:2.0:1788726003.514117:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+12:5593:x1875614914066944:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 Request processed in 163us (3854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726003.514125:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 239 00000100:00100000:0.0:1788726003.522894:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726003.523141:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914067072 00000100:00100000:1.0:1788726003.523150:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914067072 00000100:00100000:1.0:1788726003.523249:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 240 00000100:00100000:1.0:1788726003.523260:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+12:5593:x1875614914067072:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788726003.523962:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+12:5593:x1875614914067072:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 Request processed in 701us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726003.523972:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 240 00000100:00100000:0.0:1788726003.530739:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726003.531493:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914067200 00000100:00100000:2.0:1788726003.531505:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914067200 00000100:00100000:2.0:1788726003.531561:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 241 00000100:00100000:2.0:1788726003.531574:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+12:5593:x1875614914067200:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788726003.531841:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+12:5593:x1875614914067200:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 Request processed in 268us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726003.531850:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 241 00000100:00100000:0.0:1788726003.539861:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726003.546381:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914067328 00000100:00100000:3.0:1788726003.546564:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914067328 00000100:00100000:2.0:1788726003.552195:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 242 00000100:00100000:2.0:1788726003.552235:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+12:5593:x1875614914067328:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726003.552253:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726003.552270:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c11a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be90559f70 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.552297:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c11a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f70 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.552307:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c11a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f70 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726003.552316:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725e00, rc 0) 00000100:00100000:2.0:1788726003.552372:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:5593:x1875614914067328:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 Request processed in 157us (12588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726003.552379:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 242 00000100:00100000:3.0:1788726003.560846:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726003.561026:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914067456 00000100:00100000:1.0:1788726003.561037:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914067456 00000100:00100000:1.0:1788726003.561095:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 243 00000100:00100000:1.0:1788726003.561106:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:5593:x1875614914067456:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788726003.561422:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:5593:x1875614914067456:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 Request processed in 305us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726003.561431:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 243 00000100:00100000:3.0:1788726003.563306:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726003.563409:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914067584 00000100:00100000:1.0:1788726003.563428:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914067584 00000100:00100000:1.0:1788726003.563475:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 244 00000100:00100000:1.0:1788726003.563485:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:5593:x1875614914067584:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788726003.563921:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:5593:x1875614914067584:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 Request processed in 435us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726003.563931:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 244 00000100:00100000:1.0:1788726003.633761:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726003.633807:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726003.633883:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914067712 00000100:00100000:3.0:1788726003.633894:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914067712 00000100:00100000:3.0:1788726003.633962:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914067840 00000100:00100000:3.0:1788726003.633966:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914067840 00000100:00080000:1.0:1788726003.633972:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726003.633990:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:3.0:1788726003.634000:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914067712:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726003.634084:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914067712:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 85us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726003.634091:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:3.0:1788726003.634109:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:3.0:1788726003.634115:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2349:x1875614914067840:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726003.634140:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2349:x1875614914067840:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726003.634146:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 86 00010000:00010000:1.0:1788726003.733559:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726003.929145:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935075456:0@lo:400:kworker.0 00000100:00100000:0.0:1788726003.929237:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726003.929266:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935075456 00000100:00100000:3.0:1788726003.929275:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935075456 00000100:00100000:3.0:1788726003.929330:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788726003.929341:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935075456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726003.929387:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935075968:0@lo:400:kworker.0 00000100:00100000:3.0:1788726003.929393:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935075456:12345-0@lo:400:kworker.0 Request processed in 55us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726003.929399:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788726003.929412:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726003.929457:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935075456:0@lo:400:kworker.0 00000100:00100000:0.0:1788726003.929470:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788726003.929476:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935075840:0@lo:400:kworker.0 00000100:00100000:0.0:1788726003.929497:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726003.929568:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935075840 00000100:00100000:3.0:1788726003.929573:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935075840 00000100:00100000:3.0:1788726003.929609:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788726003.929615:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935075840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726003.929619:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935075584:0@lo:400:kworker.0 00000100:00100000:0.0:1788726003.929645:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726003.929654:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935075840:12345-0@lo:400:kworker.0 Request processed in 39us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726003.929661:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788726003.929661:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788726003.929666:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935075712:0@lo:400:kworker.0 00000100:00080000:3.0:1788726003.929676:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726003.929686:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726003.929712:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935075968 00000100:00100000:0.0:1788726003.929716:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935075968 00000100:00080000:3.0:1788726003.929850:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788726003.929862:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935075584 00000100:00100000:0.0:1788726003.929865:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935075584 00000100:00100000:0.0:1788726003.929955:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788726003.929961:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935075968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726003.929990:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935075968:12345-0@lo:400:kworker.0 Request processed in 30us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726003.929996:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788726003.930007:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788726003.930012:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935075584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726003.930043:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935075584:12345-0@lo:400:kworker.0 Request processed in 32us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726003.930049:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788726003.930104:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a9f5c00 x1875614935075584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726003.930115:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935075584:0@lo:400:kworker.0 00000100:00100000:0.0:1788726003.930130:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935075712 00000100:00100000:0.0:1788726003.930133:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935075712 00000100:00100000:0.0:1788726003.930153:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788726003.930158:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935075712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726003.930187:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935075712:12345-0@lo:400:kworker.0 Request processed in 29us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726003.930204:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788726003.930249:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935075712:0@lo:400:kworker.0 00000100:00080000:3.0:1788726003.930271:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788726003.930274:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788726003.930407:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935075840:0@lo:400:kworker.0 00010000:00080000:0.0:1788726003.930419:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a9f5880 x1875614935075968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726003.930427:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935075968:0@lo:400:kworker.0 00000100:00100000:0.0:1788726004.438523:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788726004.438544:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935076096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788726004.438610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726004.438678:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935076096 00000100:00100000:0.0:1788726004.438686:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935076096 00000100:00100000:0.0:1788726004.438732:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788726004.438748:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935076096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788726004.438782:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726004.438826:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935076096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726004.438833:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788726004.438874:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a9f5880 x1875614935076096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726004.438893:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935076096:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788726004.757311:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726005.479147:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788726005.479183:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935076224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788726005.479277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726005.479806:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935076224 00000100:00100000:0.0:1788726005.479816:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935076224 00000100:00100000:0.0:1788726005.479890:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788726005.479901:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935076224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788726005.479936:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726005.479991:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935076224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726005.479998:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788726005.480040:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13b17d880 x1875614935076224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726005.480059:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935076224:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788726005.480735:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788726005.786515:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788726005.804349:0:11357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788726006.805874:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726007.837172:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726008.757703:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726008.757795:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726008.757888:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726008.757919:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914067968 00000100:00100000:3.0:1788726008.757930:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914067968 00000100:00100000:3.0:1788726008.758003:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 245 00000100:00100000:3.0:1788726008.758013:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2351:x1875614914067968:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726008.758087:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2351:x1875614914067968:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 75us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726008.758094:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 245 00000100:00100000:2.0:1788726008.762922:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914068224 00000100:00100000:2.0:1788726008.762938:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914068224 00000100:00100000:2.0:1788726008.763032:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914068096 00000100:00100000:2.0:1788726008.763050:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914068096 00000100:00100000:2.0:1788726008.763087:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:2.0:1788726008.763097:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2351:x1875614914068224:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726008.763211:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:0.0:1788726008.763240:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2351:x1875614914068096:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726008.763304:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2351:x1875614914068096:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 67us (5416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726008.763313:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:2.0:1788726008.763638:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2351:x1875614914068224:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 540us (5842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726008.763645:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00080000:1.0:1788726008.766013:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788726008.853596:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726009.046155:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935076352:0@lo:400:kworker.0 00000100:00100000:3.0:1788726009.046358:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726009.046429:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935076864:0@lo:400:kworker.0 00000100:00100000:3.0:1788726009.046462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726009.046634:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788726009.046642:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935076480:0@lo:400:kworker.0 00000100:00100000:3.0:1788726009.046668:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726009.046687:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935076992:0@lo:400:kworker.0 00000100:00100000:3.0:1788726009.046802:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726009.046864:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935076608:0@lo:400:kworker.0 00000100:00100000:3.0:1788726009.046894:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726009.046918:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788726009.046925:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935076736:0@lo:400:kworker.0 00000100:00100000:3.0:1788726009.046950:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726009.046987:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935076352 00000100:00100000:3.0:1788726009.046996:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935076352 00000100:00100000:3.0:1788726009.047057:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788726009.047071:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935076352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726009.047148:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935076864 00000100:00100000:3.0:1788726009.047151:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935076352:12345-0@lo:400:kworker.0 Request processed in 82us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726009.047156:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935076864 00000100:00100000:3.0:1788726009.047163:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788726009.047212:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935076480 00000100:00100000:3.0:1788726009.047242:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935076480 00000100:00100000:2.0:1788726009.047246:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935076736 00000100:00100000:2.0:1788726009.047251:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935076736 00000100:00100000:3.0:1788726009.047266:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788726009.047276:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935076864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726009.047318:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935076864:12345-0@lo:400:kworker.0 Request processed in 43us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726009.047416:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935076992 00000100:00100000:1.0:1788726009.047421:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935076992 00000100:00100000:1.0:1788726009.047463:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935076608 00000100:00100000:1.0:1788726009.047467:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935076608 00000100:00100000:1.0:1788726009.047489:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788726009.047497:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935076992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726009.047533:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935076992:12345-0@lo:400:kworker.0 Request processed in 39us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726009.047538:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788726009.047549:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788726009.047553:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935076608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726009.047586:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935076608:12345-0@lo:400:kworker.0 Request processed in 33us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726009.047591:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788726009.049996:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788726009.050030:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935076480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726009.050157:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935076480:12345-0@lo:400:kworker.0 Request processed in 145us (3487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726009.050166:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788726009.050189:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788726009.050197:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935076736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726009.050250:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935076736:12345-0@lo:400:kworker.0 Request processed in 54us (3299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726009.050256:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1788726009.050292:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788726009.050299:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788726009.050304:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788726009.050808:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935076480:0@lo:400:kworker.0 00010000:00080000:2.0:1788726009.050831:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a611500 x1875614935076992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726009.050844:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935076992:0@lo:400:kworker.0 00000100:00100000:3.0:1788726009.050862:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788726009.050888:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935076352:0@lo:400:kworker.0 00000100:00100000:2.0:1788726009.050916:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935076864:0@lo:400:kworker.0 00000100:00100000:3.0:1788726009.050925:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935076736:0@lo:400:kworker.0 00010000:00080000:3.0:1788726009.050949:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a005960a80 x1875614935076608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726009.050961:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935076608:0@lo:400:kworker.0 00000100:00100000:0.0:1788726009.557755:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935077120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788726009.557830:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726009.557920:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935077120 00000100:00100000:0.0:1788726009.557930:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935077120 00000100:00100000:0.0:1788726009.557985:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788726009.557994:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935077120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788726009.558033:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726009.558084:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935077120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726009.558091:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788726009.558152:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a9f5880 x1875614935077120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726009.558171:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935077120:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788726009.826447:0:11457:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:20:08 (1788726008) === 00010000:00010000:0.0:1788726009.879999:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726010.152519:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726010.152622:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726010.152804:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914068480 00000100:00100000:3.0:1788726010.152814:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914068480 00000100:00100000:3.0:1788726010.152892:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:3.0:1788726010.152919:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:9666:x1875614914068480:12345-192.168.201.42@tcp:700:mkdir.0 00000100:00100000:3.0:1788726010.153005:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:9666:x1875614914068480:12345-192.168.201.42@tcp:700:mkdir.0 Request processed in 89us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726010.153013:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00080000:1.0:1788726010.153677:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788726010.155182:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914068352 00000100:00100000:2.0:1788726010.155196:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914068352 00000100:00100000:1.0:1788726010.155321:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:1.0:1788726010.155332:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914068352:12345-192.168.201.42@tcp:41:mkdir.0 00000004:00000024:1.0:1788726010.155379:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788726010.155495:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914068352:12345-192.168.201.42@tcp:41:mkdir.0 Request processed in 164us (2985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726010.155502:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:0.0:1788726010.164990:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726010.165592:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914068736 00000100:00100000:3.0:1788726010.165603:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914068736 00000100:00100000:3.0:1788726010.165671:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:3.0:1788726010.165683:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:9666:x1875614914068736:12345-192.168.201.42@tcp:36:mkdir.0 00010000:00010000:3.0:1788726010.165747:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726010.165828:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1090 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ef2 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.165852:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d600) 00010000:00010000:3.0:1788726010.165863:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788726010.166315:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71c00/0xcbde9110e47c11af lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.166330:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71c00/0xcbde9110e47c11af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.166339:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71c00/0xcbde9110e47c11af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.166368:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70a00/0xcbde9110e47c11b6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.166376:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70a00/0xcbde9110e47c11b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.166394:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70a00/0xcbde9110e47c11b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726010.173999:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788726010.174020:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71c00/0xcbde9110e47c11af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.174032:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71c00/0xcbde9110e47c11af lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.174040:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71c00/0xcbde9110e47c11af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.174045:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10db71c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726010.174050:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71c00/0xcbde9110e47c11af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.174057:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71c00/0xcbde9110e47c11af lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.174074:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639f00) 00010000:00010000:3.0:1788726010.174077:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726010.174081:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71c00/0xcbde9110e47c11af lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.174417:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71c00/0xcbde9110e47c11af lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788726010.174452:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c0d8038 reply state 000000002b7debac transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70a00/0xcbde9110e47c11b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726010.174479:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788726010.174606:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:9666:x1875614914068736:12345-192.168.201.42@tcp:36:mkdir.0 Request processed in 8915us (9615us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788726010.174616:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00010000:00010000:3.0:1788726010.181776:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70a00/0xcbde9110e47c11b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.181794:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70a00/0xcbde9110e47c11b6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.181802:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70a00/0xcbde9110e47c11b6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.181808:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10db70a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726010.181813:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70a00/0xcbde9110e47c11b6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.181821:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70a00/0xcbde9110e47c11b6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.181838:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91a111639500) 00010000:00010000:3.0:1788726010.181841:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726010.181846:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70a00/0xcbde9110e47c11b6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.181852:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70a00/0xcbde9110e47c11b6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726010.211853:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726010.212146:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914068864 00000100:00100000:2.0:1788726010.212157:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914068864 00000100:00100000:2.0:1788726010.212314:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:2.0:1788726010.212325:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:9669:x1875614914068864:12345-192.168.201.42@tcp:101:chmod.0 00010000:00010000:2.0:1788726010.212347:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726010.212383:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725400/0xcbde9110e47c11bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559f77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.212454:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c11c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.212468:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c11c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.212492:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c11c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726010.212545:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788726010.212550:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726010.212587:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c11c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.212614:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725400/0xcbde9110e47c11bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f77 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.212654:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c11c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f77 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.212664:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a11214cf00) 00010000:00010000:2.0:1788726010.212667:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788726010.212671:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724400, rc 0) 00000100:00100000:2.0:1788726010.212746:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:9669:x1875614914068864:12345-192.168.201.42@tcp:101:chmod.0 Request processed in 422us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726010.212753:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:3.0:1788726010.218244:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726010.218455:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914069120 00000100:00100000:0.0:1788726010.218466:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914069120 00000100:00100000:0.0:1788726010.218526:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:0.0:1788726010.218537:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:9669:x1875614914069120:12345-192.168.201.42@tcp:36:chmod.0 00010000:00010000:0.0:1788726010.218592:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726010.218641:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c11c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f77 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.218682:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a11214cf00) 00010000:00010000:0.0:1788726010.218694:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788726010.218731:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c11cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.218744:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c11cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.218755:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c11cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788726010.219100:0:7629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000463ee999 reply state 00000000e24a00ae transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c11cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726010.219112:0:7629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788726010.219120:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788726010.219242:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:9669:x1875614914069120:12345-192.168.201.42@tcp:36:chmod.0 Request processed in 706us (1029us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788726010.219249:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00010000:00010000:1.0:1788726010.223109:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c11cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.223130:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c11cb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.223138:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c11cb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.223144:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726010.223149:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c11cb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.223157:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c11cb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.223175:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:1.0:1788726010.223178:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788726010.223197:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c11cb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.223205:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c11cb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726010.264791:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726010.264996:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914069248 00000100:00100000:1.0:1788726010.265008:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914069248 00000100:00100000:1.0:1788726010.265076:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:1.0:1788726010.265097:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:9670:x1875614914069248:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:1.0:1788726010.265127:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726010.265153:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c11d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559f7e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.265269:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c11d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.265283:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c11d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.265294:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c11d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726010.265334:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788726010.265338:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788726010.265376:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c11d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.265415:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c11d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f7e expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.265434:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c11d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f7e expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.265451:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d700) 00010000:00010000:1.0:1788726010.265455:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788726010.265460:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea400, rc 0) 00000100:00100000:1.0:1788726010.265519:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:9670:x1875614914069248:12345-192.168.201.42@tcp:101:chown.0 Request processed in 433us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726010.265526:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:3.0:1788726010.270311:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726010.270600:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914069376 00000100:00100000:0.0:1788726010.270611:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914069376 00000100:00100000:0.0:1788726010.270675:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:0.0:1788726010.270685:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:9670:x1875614914069376:12345-192.168.201.42@tcp:101:chown.0 00010000:00010000:0.0:1788726010.270705:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726010.270724:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c11e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559f85 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.270807:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c11e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.270836:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c11e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.270857:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c11e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.270874:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c11ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.270881:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c11ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.270886:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c11ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.270981:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c11f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.270990:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c11f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.270997:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c11f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726010.271029:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788726010.271033:0:7629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788726010.271056:0:7629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c11f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.271068:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c11e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.271085:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c11e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.271102:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c11e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.271108:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726010.271113:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c11e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.271121:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c11e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.271136:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d700) 00010000:00010000:0.0:1788726010.271139:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726010.271145:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c11e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.271152:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c11e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.271166:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c11ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.271172:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c11ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.271178:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c11ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.271183:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726010.271192:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c11ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.271198:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c11ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.271206:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91a12bdfef00) 00010000:00010000:0.0:1788726010.271209:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726010.271212:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c11ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.272691:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c11ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.272756:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c11e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f85 expref: 10 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.272780:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c11f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f85 expref: 9 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.272790:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a12bdfed00) 00010000:00010000:0.0:1788726010.272792:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788726010.272796:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100030a00, rc 0) 00000100:00100000:0.0:1788726010.273596:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:9670:x1875614914069376:12345-192.168.201.42@tcp:101:chown.0 Request processed in 2906us (3288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726010.274278:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:0.0:1788726010.278786:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726010.278881:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914069632 00000100:00100000:1.0:1788726010.278892:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914069632 00000100:00100000:1.0:1788726010.278959:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:1.0:1788726010.278969:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:9670:x1875614914069632:12345-192.168.201.42@tcp:36:chown.0 00010000:00010000:1.0:1788726010.279025:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726010.279053:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c11f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f85 expref: 9 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.279075:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a12bdfed00) 00010000:00010000:1.0:1788726010.279085:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788726010.279122:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c11fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.279135:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c11fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.279144:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c11fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788726010.372967:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007dc072d6 reply state 00000000ef156425 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c11fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726010.372995:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788726010.373019:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788726010.373208:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:9670:x1875614914069632:12345-192.168.201.42@tcp:36:chown.0 Request processed in 94233us (94425us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788726010.373242:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000001:00080000:3.0:1788726010.377014:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1788726010.377067:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1788726010.379268:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c11fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.379335:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c11fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.379610:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c11fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.379619:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eae00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726010.379625:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c11fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.379634:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c11fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.379656:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a10d14d500) 00010000:00010000:0.0:1788726010.379659:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788726010.379667:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c11fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.379673:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c11fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726010.424072:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726010.424270:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914069760 00000100:00100000:3.0:1788726010.424284:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914069760 00000100:00100000:3.0:1788726010.424377:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:3.0:1788726010.424391:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:9671:x1875614914069760:12345-192.168.201.42@tcp:101:touch.500 00010000:00010000:3.0:1788726010.424424:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726010.424453:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70a00/0xcbde9110e47c1203 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559f8c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788726010.432971:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 8441us 00010000:00010000:1.0:1788726010.478861:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c120a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.478914:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c120a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.478929:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c120a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.478948:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1211 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.478955:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1211 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.478961:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1211 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.479536:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1218 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.479547:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1218 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.479556:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1218 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726010.479809:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788726010.479814:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788726010.479892:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1218 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.479909:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c120a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.479925:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c120a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.479932:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c120a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.479938:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726010.479943:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c120a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.479951:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c120a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.479965:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d700) 00010000:00010000:1.0:1788726010.479969:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726010.479974:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c120a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.479979:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c120a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.479994:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1211 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.480000:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1211 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.480006:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1211 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.480012:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726010.480021:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1211 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.480028:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1211 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.480037:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91a10d14d000) 00010000:00010000:1.0:1788726010.480039:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726010.480042:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1211 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.480048:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1211 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.480108:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70a00/0xcbde9110e47c1203 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f8c expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.480128:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1218 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f8c expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.480137:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:1.0:1788726010.480139:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788726010.480141:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ebe00, rc 0) 00000100:00100000:1.0:1788726010.480271:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:9671:x1875614914069760:12345-192.168.201.42@tcp:101:touch.500 Request processed in 55880us (56209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726010.480282:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:2.0:1788726010.487435:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726010.487699:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914070016 00000100:00100000:3.0:1788726010.487714:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914070016 00000100:00100000:3.0:1788726010.487792:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:3.0:1788726010.487804:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:9671:x1875614914070016:12345-192.168.201.42@tcp:101:touch.500 00010000:00010000:3.0:1788726010.487833:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726010.487863:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71c00/0xcbde9110e47c121f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559f93 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.489174:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71a00/0xcbde9110e47c1226 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.489204:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71a00/0xcbde9110e47c1226 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.489721:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71a00/0xcbde9110e47c1226 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.489766:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71e00/0xcbde9110e47c122d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.489775:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71e00/0xcbde9110e47c122d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.489782:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71e00/0xcbde9110e47c122d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788726010.492913:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788726010.494021:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70600/0xcbde9110e47c1234 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.494048:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70600/0xcbde9110e47c1234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.494062:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70600/0xcbde9110e47c1234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.494157:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71a00/0xcbde9110e47c1226 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.494166:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71a00/0xcbde9110e47c1226 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.494174:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71a00/0xcbde9110e47c1226 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.494180:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10db71a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726010.494185:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71a00/0xcbde9110e47c1226 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.494208:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71a00/0xcbde9110e47c1226 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.494480:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:3.0:1788726010.494484:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726010.494490:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71a00/0xcbde9110e47c1226 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.494498:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71a00/0xcbde9110e47c1226 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788726010.494516:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f32262d6 reply state 00000000e96169c5 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71e00/0xcbde9110e47c122d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726010.494526:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788726010.494635:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71c00/0xcbde9110e47c121f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f93 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.494651:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70600/0xcbde9110e47c1234 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f93 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726010.494658:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a111639f00) 00010000:00010000:3.0:1788726010.494660:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726010.494663:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10db70600, rc 0) 00000100:00100000:3.0:1788726010.494827:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:9671:x1875614914070016:12345-192.168.201.42@tcp:101:touch.500 Request processed in 7024us (7407us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788726010.494838:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:0.0:1788726010.501137:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726010.501867:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914070272 00000100:00100000:2.0:1788726010.501883:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914070272 00000100:00100000:2.0:1788726010.501970:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:2.0:1788726010.501983:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:9671:x1875614914070272:12345-192.168.201.42@tcp:36:touch.500 00010000:00010000:2.0:1788726010.502080:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726010.502126:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db70600/0xcbde9110e47c1234 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f93 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.502177:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a111639f00) 00010000:00010000:2.0:1788726010.502192:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788726010.502292:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1242 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.502508:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.502522:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788726010.502701:0:7629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000185e3072 reply state 000000004ed9fd73 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726010.502712:0:7629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788726010.502883:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:9671:x1875614914070272:12345-192.168.201.42@tcp:36:touch.500 Request processed in 901us (1761us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788726010.502891:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00010000:00010000:1.0:1788726010.504021:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71e00/0xcbde9110e47c122d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.504039:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71e00/0xcbde9110e47c122d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.504068:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71e00/0xcbde9110e47c122d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.504074:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10db71e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726010.504080:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71e00/0xcbde9110e47c122d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.504101:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71e00/0xcbde9110e47c122d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.504124:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x68574761 (ffff91a111639500) 00010000:00010000:1.0:1788726010.504127:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726010.504133:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71e00/0xcbde9110e47c122d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.504139:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10db71e00/0xcbde9110e47c122d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726010.508323:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:1.0:1788726010.508417:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.508432:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1242 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.508441:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1242 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.508447:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a117437c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726010.508453:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1242 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.508482:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1242 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.508509:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a11214c000) 00010000:00010000:1.0:1788726010.508513:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726010.508521:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1242 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.508528:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1242 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726010.508874:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914070400 00000100:00100000:2.0:1788726010.508892:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914070400 00000100:00100000:2.0:1788726010.508965:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:2.0:1788726010.508977:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:9671:x1875614914070400:12345-192.168.201.42@tcp:101:touch.500 00010000:00010000:2.0:1788726010.509009:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726010.509033:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436400/0xcbde9110e47c1249 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559f9a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.509124:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436400/0xcbde9110e47c1249 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f9a expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.509171:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436400/0xcbde9110e47c1249 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f9a expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.509196:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a11214c500) 00010000:00010000:2.0:1788726010.509199:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788726010.509202:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a117436400, rc 0) 00000100:00100000:2.0:1788726010.510185:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:9671:x1875614914070400:12345-192.168.201.42@tcp:101:touch.500 Request processed in 1200us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726010.510199:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:3.0:1788726010.514108:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726010.514993:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914070528 00000100:00100000:1.0:1788726010.515010:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914070528 00000100:00100000:0.0:1788726010.515626:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:0.0:1788726010.515638:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875614914070528:12345-192.168.201.42@tcp:8:touch.500 00010000:00080000:0.0:1788726010.515689:0:9742:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp t0 exp 0000000000000000 cur 305 last 0 00000020:00000080:0.0:1788726010.515729:0:9742:0:(genops.c:1385:class_connect()) connect: client 7c11f8bd-dcce-4bc6-a067-83d611fb0a24, cookie 0xcbde9110e47c1250 00002000:00100000:0.0:1788726010.515744:0:9742:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7c11f8bd-dcce-4bc6-a067-83d611fb0a24/ffff91a13a56a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788726010.515774:0:9742:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:0.0:1788726010.516095:0:9742:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788726010.516149:0:9742:0:(import.c:65:import_set_state_nolock()) ffff91a13a56d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788726010.516337:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2348:x1875614914070528:12345-192.168.201.42@tcp:8:touch.500 Request processed in 699us (2254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726010.516356:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:1.0:1788726010.524055:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726010.525049:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914070656 00000100:00100000:0.0:1788726010.525067:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914070656 00000100:00100000:0.0:1788726010.525537:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:0.0:1788726010.525551:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:0:x1875614914070656:12345-192.168.201.42@tcp:2:touch.500 00000100:00080000:1.0:1788726010.526050:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788726010.567698:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1788726010.567723:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000100:00100000:0.0:1788726010.567915:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:0:x1875614914070656:12345-192.168.201.42@tcp:2:touch.500 Request processed in 42358us (43867us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788726010.567930:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:3.0:1788726010.570805:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726010.570979:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914070912 00000100:00100000:1.0:1788726010.570995:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914070912 00000100:00100000:1.0:1788726010.571072:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:1.0:1788726010.571095:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:9671:x1875614914070912:12345-192.168.201.42@tcp:35:touch.500 00000100:00100000:1.0:1788726010.572092:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:9671:x1875614914070912:12345-192.168.201.42@tcp:35:touch.500 Request processed in 991us (1284us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788726010.572106:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:0.0:1788726010.582051:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935077248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788726010.582166:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726010.582547:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935077248 00000100:00100000:1.0:1788726010.582559:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935077248 00000100:00100000:1.0:1788726010.582642:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788726010.582654:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935077248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788726010.582724:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788726010.585717:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935077248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3046us (3533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726010.585738:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788726010.586627:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a005960a80 x1875614935077248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726010.586662:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935077248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788726010.591313:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726010.591617:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914071040 00000100:00100000:1.0:1788726010.591633:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914071040 00000100:00100000:1.0:1788726010.591715:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:1.0:1788726010.591728:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:9672:x1875614914071040:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:1.0:1788726010.591767:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726010.591795:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1257 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559fa1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.591886:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c125e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.591904:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c125e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.591919:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c125e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726010.591972:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788726010.591977:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788726010.592028:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c125e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.592061:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1257 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fa1 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.592122:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c125e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fa1 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.592133:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:1.0:1788726010.592136:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788726010.592140:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea600, rc 0) 00000100:00100000:1.0:1788726010.593191:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+12:9672:x1875614914071040:12345-192.168.201.42@tcp:101:rm.0 Request processed in 1453us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726010.593205:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:0.0:1788726010.596924:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726010.597054:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914071296 00000100:00100000:2.0:1788726010.597068:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914071296 00000100:00100000:2.0:1788726010.597198:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:2.0:1788726010.597211:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+12:9672:x1875614914071296:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:2.0:1788726010.597717:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726010.597747:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436c00/0xcbde9110e47c1265 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559fa8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726010.597865:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788726010.598096:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436c00/0xcbde9110e47c1265 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fa8 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.598114:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d700) 00010000:00010000:2.0:1788726010.598117:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788726010.598123:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436c00/0xcbde9110e47c1265 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fa8 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.598152:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a117436c00, rc 0) 00000100:00100000:2.0:1788726010.598739:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:9672:x1875614914071296:12345-192.168.201.42@tcp:101:rm.0 Request processed in 1525us (1825us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788726010.598751:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:0.0:1788726010.604061:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726010.604170:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914071424 00000100:00100000:3.0:1788726010.604183:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914071424 00000100:00100000:3.0:1788726010.604425:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:3.0:1788726010.604438:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:9672:x1875614914071424:12345-192.168.201.42@tcp:37:rm.0 00000100:00100000:2.0:1788726010.611061:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:9672:x1875614914071424:12345-192.168.201.42@tcp:37:rm.0 Request processed in 6608us (7000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726010.611079:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:0.0:1788726010.616057:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726010.616264:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914071680 00000100:00100000:1.0:1788726010.616278:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914071680 00000100:00100000:1.0:1788726010.616375:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:1.0:1788726010.616387:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111085050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:9672:x1875614914071680:12345-192.168.201.42@tcp:35:rm.0 00000100:00100000:1.0:1788726010.616708:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111085050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:9672:x1875614914071680:12345-192.168.201.42@tcp:35:rm.0 Request processed in 322us (677us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788726010.616716:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:0.0:1788726010.620662:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726010.620785:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914071936 00000100:00100000:2.0:1788726010.620800:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914071936 00000100:00100000:2.0:1788726010.620879:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:2.0:1788726010.620892:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:9672:x1875614914071936:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:2.0:1788726010.620926:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726010.620953:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436c00/0xcbde9110e47c1273 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559faf expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.621100:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c127a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.621117:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c127a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.621131:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c127a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726010.621145:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788726010.621656:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436c00/0xcbde9110e47c1273 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559faf expref: 17 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.621707:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c127a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559faf expref: 16 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.621718:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:2.0:1788726010.621720:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788726010.621725:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a117436800, rc 0) 00000100:00100000:2.0:1788726010.621917:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:9672:x1875614914071936:12345-192.168.201.42@tcp:101:rm.0 Request processed in 1026us (1271us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788726010.621926:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:2.0:1788726010.626885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726010.626993:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914072064 00000100:00100000:3.0:1788726010.627009:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914072064 00000100:00100000:3.0:1788726010.627487:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:3.0:1788726010.627501:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:9672:x1875614914072064:12345-192.168.201.42@tcp:41:rm.0 00000004:00000024:3.0:1788726010.627586:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788726010.627674:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:9672:x1875614914072064:12345-192.168.201.42@tcp:41:rm.0 Request processed in 176us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726010.627683:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:0.0:1788726010.632801:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726010.632918:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914072192 00000100:00100000:1.0:1788726010.632932:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914072192 00000100:00100000:1.0:1788726010.633008:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:1.0:1788726010.633021:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:9672:x1875614914072192:12345-192.168.201.42@tcp:101:rm.0 00010000:00010000:1.0:1788726010.633170:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726010.633203:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1288 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559fb6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633488:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c128f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633529:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c128f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633543:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c128f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633562:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1296 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633569:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633575:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633707:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c129d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633716:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c129d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633723:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c129d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726010.633756:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788726010.633761:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788726010.633782:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c129d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633795:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c129d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633816:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c128f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633823:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c128f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633830:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c128f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633836:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726010.633841:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c128f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633848:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c128f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633862:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:1.0:1788726010.633865:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726010.633871:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c128f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633877:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c128f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633894:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633900:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1296 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633907:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633918:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726010.633921:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633926:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1296 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633936:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x68574761 (ffff91a10d14d000) 00010000:00010000:1.0:1788726010.633938:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726010.633940:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1296 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633946:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1296 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633985:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1288 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fb6 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.633999:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c129d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fb6 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.634006:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a11214c500) 00010000:00010000:1.0:1788726010.634008:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788726010.634011:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea000, rc 0) 00000100:00100000:1.0:1788726010.634496:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+17:9672:x1875614914072192:12345-192.168.201.42@tcp:101:rm.0 Request processed in 1475us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726010.634506:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:2.0:1788726010.638879:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726010.638983:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914072448 00000100:00100000:1.0:1788726010.639018:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914072448 00000100:00100000:1.0:1788726010.639114:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:1.0:1788726010.639128:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+17:9672:x1875614914072448:12345-192.168.201.42@tcp:36:rm.0 00010000:00010000:1.0:1788726010.639212:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788726010.639289:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c129d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fb6 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.639325:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436400/0xcbde9110e47c1249 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f9a expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.639345:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a11214c500) 00010000:00010000:1.0:1788726010.639365:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c125e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fa1 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.639374:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:1.0:1788726010.639378:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788726010.639402:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c12a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.639418:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c12a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.639429:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c12a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.639447:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c12ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.639454:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c12ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.639473:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c12ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.639611:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c12b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.639620:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c12b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.639627:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c12b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788726010.640565:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788726010.640581:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 305690364521ns, next at 306690361803ns, rc = 0 00010000:00010000:1.0:1788726010.640658:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c12b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640672:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c12b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640682:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c12b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640690:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c12b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640696:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c12b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640703:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c12b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640741:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788726010.640768:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c12b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640775:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c12b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640780:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c12b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640786:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eac00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726010.640791:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c12b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640799:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c12b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640810:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a10d14d900) 00010000:00010000:1.0:1788726010.640814:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788726010.640818:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c12b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640825:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c12b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640847:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c12a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640854:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c12a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640859:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c12a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640871:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eaa00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726010.640875:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c12a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640881:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c12a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640890:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:1.0:1788726010.640893:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726010.640896:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c12a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.640902:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c12a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788726010.640913:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fae01d55 reply state 000000003243f6d6 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c12ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726010.640923:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788726010.641042:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:9672:x1875614914072448:12345-192.168.201.42@tcp:36:rm.0 Request processed in 1912us (2176us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788726010.641052:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00010000:00010000:2.0:1788726010.641392:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726010.641401:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c12b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.641409:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eba00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726010.641412:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c12b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.641419:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c12b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.641430:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91a10d14d900) 00010000:00010000:2.0:1788726010.641432:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788726010.641436:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c12b9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.641442:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c12b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.641472:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726010.641474:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726010.641475:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726010.645559:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726010.646012:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914072704 00000100:00100000:3.0:1788726010.646027:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914072704 00000100:00100000:3.0:1788726010.646122:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:3.0:1788726010.646134:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:9672:x1875614914072704:12345-192.168.201.42@tcp:35:rm.0 00000100:00100000:3.0:1788726010.646687:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+17:9672:x1875614914072704:12345-192.168.201.42@tcp:35:rm.0 Request processed in 552us (1141us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788726010.646696:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00010000:00010000:1.0:1788726010.647553:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c12ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.647569:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c12ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.647577:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c12ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.647609:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eae00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726010.647615:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c12ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.647623:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c12ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.647643:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x68574761 (ffff91a10d14d100) 00010000:00010000:1.0:1788726010.647647:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726010.647652:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c12ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726010.647659:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c12ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726010.650818:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726010.650925:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914072960 00000100:00100000:0.0:1788726010.650939:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914072960 00000100:00100000:0.0:1788726010.651050:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:0.0:1788726010.651062:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:9672:x1875614914072960:12345-192.168.201.42@tcp:36:rm.0 00010000:00010000:0.0:1788726010.651154:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788726010.651192:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c127a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559faf expref: 16 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.651247:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1218 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f8c expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.651265:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:0.0:1788726010.651286:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c11d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f7e expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.651510:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d700) 00010000:00010000:0.0:1788726010.651519:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788726010.651559:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031800/0xcbde9110e47c12c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.651574:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031800/0xcbde9110e47c12c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.651585:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031800/0xcbde9110e47c12c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.651599:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c12c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.651606:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c12c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.651625:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c12c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.651970:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c12ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.651979:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c12ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.651986:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c12ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726010.657194:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788726010.657265:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c12ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.657278:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c12ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.657286:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c12ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.657849:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726010.657856:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c12ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.657866:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c12ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.657888:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91a12bdfe100) 00010000:00010000:0.0:1788726010.657892:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788726010.657909:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c12ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.657917:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c12ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.657952:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031800/0xcbde9110e47c12c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.657960:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031800/0xcbde9110e47c12c0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.657968:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031800/0xcbde9110e47c12c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.657972:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726010.657975:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031800/0xcbde9110e47c12c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.657981:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031800/0xcbde9110e47c12c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.657990:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a12bdfec00) 00010000:00010000:0.0:1788726010.657993:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726010.657996:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031800/0xcbde9110e47c12c0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.658004:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031800/0xcbde9110e47c12c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788726010.658018:0:7629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008563ef4d reply state 00000000bf517f97 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c12c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726010.658106:0:7629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788726010.658529:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:9672:x1875614914072960:12345-192.168.201.42@tcp:36:rm.0 Request processed in 7462us (7719us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788726010.664453:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00010000:00010000:0.0:1788726010.671350:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c12c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.671375:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c12c7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.671384:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c12c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.671390:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726010.671396:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c12c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.671403:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c12c7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.671426:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91a12bdfef00) 00010000:00010000:0.0:1788726010.671429:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726010.671434:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c12c7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726010.671440:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c12c7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726010.901549:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726011.925565:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726012.949545:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726013.871185:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726013.871257:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726013.871287:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726013.871317:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726013.871350:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914073216 00000100:00100000:1.0:1788726013.871359:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914073216 00000100:00100000:1.0:1788726013.871415:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914073472 00000100:00100000:1.0:1788726013.871419:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914073472 00000100:00100000:1.0:1788726013.871444:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 95 00000100:00100000:1.0:1788726013.871453:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:2351:x1875614914073216:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726013.871528:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:2351:x1875614914073216:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 76us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726013.871701:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00100000:2.0:1788726013.871711:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2351:x1875614914073472:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788726013.871742:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2351:x1875614914073472:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 33us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726013.871750:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00100000:1.0:1788726013.872106:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 95 00000100:00100000:1.0:1788726013.872129:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914073088 00000100:00100000:1.0:1788726013.872134:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914073088 00000100:00100000:1.0:1788726013.872173:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 247 00000100:00100000:1.0:1788726013.872181:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:2351:x1875614914073088:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726013.872240:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:2351:x1875614914073088:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 36us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726013.872247:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 247 00000100:00100000:1.0:1788726013.872276:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914073344 00000100:00100000:1.0:1788726013.872281:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914073344 00000100:00100000:1.0:1788726013.872312:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:1.0:1788726013.872320:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914073344:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726013.872348:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914073344:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 31us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726013.872354:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00080000:1.0:1788726013.872370:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788726013.872374:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788726013.974550:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726014.165723:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935077760:0@lo:400:kworker.0 00000100:00100000:0.0:1788726014.165796:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726014.165854:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788726014.165859:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935077632:0@lo:400:kworker.0 00000100:00100000:0.0:1788726014.165883:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726014.165919:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935077760 00000100:00100000:0.0:1788726014.165927:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935077760 00000100:00100000:0.0:1788726014.165982:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788726014.165993:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935077760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726014.166060:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935077760:12345-0@lo:400:kworker.0 Request processed in 69us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726014.166067:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788726014.166091:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935077632 00000100:00100000:0.0:1788726014.166095:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935077632 00000100:00100000:0.0:1788726014.166121:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788726014.166127:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935077632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726014.166157:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935077632:12345-0@lo:400:kworker.0 Request processed in 30us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726014.166163:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788726014.166179:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788726014.166183:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788726014.166257:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a444700 x1875614935077632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726014.166273:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935077632:0@lo:400:kworker.0 00000100:00100000:0.0:1788726014.166297:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935077760:0@lo:400:kworker.0 00000100:00100000:2.0:1788726014.167911:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935077376:0@lo:400:kworker.0 00000100:00100000:2.0:1788726014.167974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726014.168018:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935077888:0@lo:400:kworker.0 00000100:00100000:2.0:1788726014.168079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726014.168108:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788726014.168115:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935077504:0@lo:400:kworker.0 00000100:00100000:2.0:1788726014.168135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726014.168153:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935078016:0@lo:400:kworker.0 00000100:00100000:2.0:1788726014.168172:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726014.168201:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935077888 00000100:00100000:2.0:1788726014.168207:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935077888 00000100:00100000:2.0:1788726014.168276:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935077504 00000100:00100000:2.0:1788726014.168388:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935077504 00000100:00100000:2.0:1788726014.168528:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788726014.168537:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935077888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726014.168592:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935077888:12345-0@lo:400:kworker.0 Request processed in 56us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726014.168600:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788726014.168615:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788726014.168620:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935077504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726014.168643:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935077504:12345-0@lo:400:kworker.0 Request processed in 24us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726014.168648:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788726014.168664:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935078016 00000100:00100000:2.0:1788726014.168667:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935078016 00000100:00100000:2.0:1788726014.168692:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788726014.168697:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935078016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726014.168724:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935078016:12345-0@lo:400:kworker.0 Request processed in 27us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726014.168730:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788726014.168751:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788726014.168754:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788726014.168781:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935077504:0@lo:400:kworker.0 00010000:00080000:2.0:1788726014.168791:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a446d80 x1875614935078016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726014.168801:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935078016:0@lo:400:kworker.0 00000100:00100000:2.0:1788726014.168809:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935077888:0@lo:400:kworker.0 00000100:00100000:1.0:1788726014.168966:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935077376 00000100:00100000:1.0:1788726014.168971:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935077376 00000100:00100000:1.0:1788726014.169008:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788726014.169016:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935077376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726014.169074:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935077376:12345-0@lo:400:kworker.0 Request processed in 59us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726014.169080:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788726014.169160:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935077376:0@lo:400:kworker.0 00000004:00080000:0.0:1788726014.678521:0:7884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 309728303391ns, next at 310728300275ns, rc = 0 00000100:00100000:0.0:1788726014.678560:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788726014.678604:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935078144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788726014.678686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726014.678753:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935078144 00000100:00100000:0.0:1788726014.678760:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935078144 00000100:00100000:0.0:1788726014.678804:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788726014.678814:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935078144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788726014.678848:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726014.678892:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935078144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726014.678899:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788726014.678939:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a447100 x1875614935078144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726014.678957:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935078144:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788726014.997571:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788726015.476545:0:11606:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1788726015.703990:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935078272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788726015.704082:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726015.704173:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935078272 00000100:00100000:0.0:1788726015.704183:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935078272 00000100:00100000:0.0:1788726015.704497:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788726015.704509:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935078272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788726015.704545:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726015.704634:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935078272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726015.704642:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788726015.717695:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1117cd500 x1875614935078272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726015.717784:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935078272:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788726015.778707:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788726015.778735:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1788726015.778746:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788726015.778907:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935078400:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788726015.778971:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726015.779051:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935078400 00000100:00100000:0.0:1788726015.779058:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935078400 00000100:00100000:0.0:1788726015.779097:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788726015.779106:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935078400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788726015.779130:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788726015.779164:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9dcafa, atime: 0x6a9dcafa, ctime: 0x6a9dcafa, blocks: 0x1 00010000:00010000:0.0:1788726015.779172:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaf4377a/0xcbde9110e47c12d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726015.779188:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=310s v=(0 0) 00010000:00010000:0.0:1788726015.779194:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726015.779200:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf4377a/0xcbde9110e47c12d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726015.779258:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaf4377a/0xcbde9110e47c12d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726015.779269:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaf4377a/0xcbde9110e47c12d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726015.779276:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf4377a/0xcbde9110e47c12d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726015.779294:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788726015.780059:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875614935078400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 949us (1083us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788726015.780078:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788726015.780108:0:8493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726015.780115:0:8493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aaf4377a/0xcbde9110e47c12d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726015.780124:0:8493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031800 already unused, calling callback (ffffffffc142a230) 00010000:00010000:0.0:1788726015.780129:0:8493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaf4377a/0xcbde9110e47c12d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726015.780139:0:8493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaf4377a/0xcbde9110e47c12d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726015.780157:0:8493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aaf4377a/0xcbde9110e47c12d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726015.780165:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaf4377a/0xcbde9110e47c12d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726015.780185:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726015.780186:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726015.780188:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788726015.780378:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a13a445180/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788726015.780386:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935078400:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788726016.022164:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788726016.616594:0:11657:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb0d2d6a0 20000000:00000080:2.0:1788726016.616631:0:11657:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91a1117c9c00 uarg=0000000000000000 20000000:01000000:2.0:1788726016.616667:0:11657:0:(mgs_llog.c:6195:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788726016.616674:0:11657:0:(mgs_llog.c:4650:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788726016.616679:0:11657:0:(mgs_llog.c:1382:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788726016.619696:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788726016.619961:0:11657:0:(mgs_llog.c:4123:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788726016.632540:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788726016.632598:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788726016.632655:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788726016.632673:0:11657:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788726016.632694:0:11657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a117436c00/0xcbde9110e47c12dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726016.632713:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c117e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c1177 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726016.632721:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a1398eb200/0xcbde9110e47c118c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c1185 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726016.632729:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c119a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c1193 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726016.632739:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10e725200/0xcbde9110e47c11a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f69 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726016.632747:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c11a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f70 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726016.632755:0:11657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a117436c00/0xcbde9110e47c12dc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726016.632794:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c11a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f70 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726016.632820:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c11a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f70 expref: 12 pid: 5829 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726016.632835:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875614935078528:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726016.632948:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10e725200/0xcbde9110e47c11a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f69 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726016.632957:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a10e725200/0xcbde9110e47c11a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f69 expref: 12 pid: 5828 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726016.632964:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875614935078656:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726016.639086:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c119a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c1193 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726016.639105:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c119a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c1193 expref: 18 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726016.639121:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875614935078784:0@lo:104: 00000100:00100000:0.0:1788726016.646649:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726016.646759:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726016.647076:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914073600 00000100:00100000:3.0:1788726016.647087:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914073600 00010000:00010000:3.0:1788726016.647125:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c11a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f70 expref: 13 pid: 5829 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726016.647165:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914073728 00000100:00100000:3.0:1788726016.647168:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914073728 00010000:00010000:3.0:1788726016.647180:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10e725200/0xcbde9110e47c11a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f69 expref: 14 pid: 5828 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726016.647208:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:3.0:1788726016.647240:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a444e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2306ca11-4668-43b2-bddf-879669734d27+14:2350:x1875614914073600:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726016.647256:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726016.647276:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c11a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f70 expref: 14 pid: 5829 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726016.647289:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c11a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f70 expref: 14 pid: 5829 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726016.647311:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726016.647365:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a444e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2306ca11-4668-43b2-bddf-879669734d27+14:2350:x1875614914073600:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 148us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726016.647372:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:3.0:1788726016.647389:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:3.0:1788726016.647395:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a445880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2306ca11-4668-43b2-bddf-879669734d27+13:2349:x1875614914073728:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726016.647404:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726016.647409:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10e725200/0xcbde9110e47c11a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f69 expref: 13 pid: 5828 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726016.647435:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10e725200/0xcbde9110e47c11a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f69 expref: 13 pid: 5828 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726016.647445:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726016.647464:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a445880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2306ca11-4668-43b2-bddf-879669734d27+13:2349:x1875614914073728:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 69us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726016.647470:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:2.0:1788726016.648289:0:11657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788726016.648362:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a1398eb200/0xcbde9110e47c118c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c1185 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726016.648377:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a1398eb200/0xcbde9110e47c118c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c1185 expref: 18 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726016.648841:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935078784 00000100:00100000:1.0:1788726016.648850:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935078784 00000100:00100000:1.0:1788726016.648899:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788726016.648909:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:11657:x1875614935078784:12345-0@lo:104: 00010000:00010000:1.0:1788726016.648923:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a1398eb800/0xcbde9110e47c1193 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c119a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.648976:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788726016.648993:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:11657:x1875614935078784:12345-0@lo:104: Request processed in 86us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726016.648999:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788726016.649016:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726016.649023:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a1398eb800/0xcbde9110e47c1193 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c119a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.649029:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb800 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:1.0:1788726016.649034:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a1398eb800/0xcbde9110e47c1193 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c119a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.649041:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a1398eb800/0xcbde9110e47c1193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c119a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788726016.649048:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a1398eb800/0xcbde9110e47c1193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c119a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726016.649055:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788726016.649104:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a1398eb800/0xcbde9110e47c1193 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c119a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.649111:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788726016.649133:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a1398eb800/0xcbde9110e47c1193 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c119a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.649140:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a1398eb800/0xcbde9110e47c1193 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c119a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.649152:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726016.649154:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726016.649156:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726016.649162:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788726016.649177:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935079040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788726016.649211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726016.649305:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935079040 00000100:00100000:1.0:1788726016.649309:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935079040 00010000:00010000:1.0:1788726016.649327:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c119a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c1193 expref: 19 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726016.649348:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788726016.649355:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935079040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788726016.649364:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726016.649369:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c119a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c1193 expref: 19 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726016.649444:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875614935078912:0@lo:104: 00000100:00100000:2.0:1788726016.649508:0:11657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726016.649571:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788726016.649584:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935078912 00000100:00100000:3.0:1788726016.649588:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935078912 00000100:00100000:3.0:1788726016.649690:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788726016.649698:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a0050c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:11657:x1875614935078912:12345-0@lo:104: 00010000:00010000:3.0:1788726016.649707:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c1185 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c118c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726016.649746:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788726016.649752:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a0050c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:11657:x1875614935078912:12345-0@lo:104: Request processed in 56us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726016.649757:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788726016.649792:0:8494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726016.649797:0:8494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c1185 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c118c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726016.649804:0:8494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724600 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:3.0:1788726016.649807:0:8494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c1185 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c118c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726016.649814:0:8494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c1185 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c118c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788726016.649829:0:8494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c1185 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c118c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726016.649834:0:8494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788726016.649862:0:8494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c1185 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c118c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726016.649868:0:8494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788726016.649884:0:8494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c1185 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c118c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726016.649891:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c1185 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c118c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726016.649901:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726016.649903:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726016.649905:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726016.649915:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935079168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788726016.649944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726016.651647:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935079168 00000100:00100000:0.0:1788726016.651661:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935079168 00010000:00010000:0.0:1788726016.651701:0:8495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a1398eb200/0xcbde9110e47c118c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c1185 expref: 20 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726016.651744:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788726016.651752:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1202a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+20:3304:x1875614935079168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726016.651765:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726016.651771:0:8495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a1398eb200/0xcbde9110e47c118c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c1185 expref: 20 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.651830:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c119a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c1193 expref: 20 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.651853:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726016.651925:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+20:3306:x1875614935079040:12345-0@lo:103:ldlm_bl.0 Request processed in 2570us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726016.651932:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788726016.651977:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935079040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788726016.652132:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c117e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c1177 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726016.652144:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c117e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c1177 expref: 19 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726016.652158:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875614935079296:0@lo:104: 00000100:00100000:2.0:1788726016.652206:0:11657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726016.652534:0:11657:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1067f96c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788726016.652553:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c11a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f70 expref: 12 pid: 5829 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726016.652565:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875614935078528:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726016.652575:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e725200/0xcbde9110e47c11a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559f69 expref: 11 pid: 5828 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726016.652583:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875614935078656:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726016.652592:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e724c00/0xcbde9110e47c119a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c1193 expref: 19 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726016.652600:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875614935078784:0@lo:104: 00000100:00100000:2.0:1788726016.652610:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875614935078912:0@lo:104: 00010000:00010000:0.0:1788726016.652738:0:8495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a1398eb200/0xcbde9110e47c118c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c1185 expref: 18 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726016.652753:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a1398eb200/0xcbde9110e47c118c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c1185 expref: 18 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726016.652764:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726016.652849:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1202a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:3304:x1875614935079168:12345-0@lo:103:ldlm_bl.0 Request processed in 1097us (2903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726016.652857:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788726016.652905:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935079296 00000100:00100000:3.0:1788726016.652912:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935079296 00000100:00100000:2.0:1788726016.652947:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935079168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788726016.652960:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788726016.652971:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:11657:x1875614935079296:12345-0@lo:104: 00010000:00010000:3.0:1788726016.652994:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10e725000/0xcbde9110e47c1177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c117e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726016.653053:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788726016.653060:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+3:11657:x1875614935079296:12345-0@lo:104: Request processed in 92us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726016.653066:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875614935079296:0@lo:104: 00000100:00100000:3.0:1788726016.653079:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1788726016.653097:0:11657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a117436c00/0xcbde9110e47c12dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653369:0:8493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726016.653376:0:8493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e725000/0xcbde9110e47c1177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c117e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653384:0:8493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725000 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:1.0:1788726016.653389:0:8493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725000/0xcbde9110e47c1177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c117e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653396:0:8493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e725000/0xcbde9110e47c1177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c117e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788726016.653404:0:8493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725000/0xcbde9110e47c1177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c117e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726016.653409:0:8493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788726016.653442:0:8493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e725000/0xcbde9110e47c1177 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c117e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653448:0:8493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788726016.653467:0:8493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e725000/0xcbde9110e47c1177 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c117e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653473:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e725000/0xcbde9110e47c1177 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c117e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653486:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726016.653494:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726016.653496:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726016.653561:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935079424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788726016.653692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726016.653763:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935079424 00000100:00100000:1.0:1788726016.653769:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935079424 00010000:00010000:1.0:1788726016.653793:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c117e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c1177 expref: 17 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726016.653822:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788726016.653829:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:3305:x1875614935079424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788726016.653840:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726016.653845:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c117e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c1177 expref: 17 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653855:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c117e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c1177 expref: 17 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653868:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a1398ebc00/0xcbde9110e47c117e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c1177 expref: 17 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653881:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a117436c00/0xcbde9110e47c12dc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653889:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a117436c00/0xcbde9110e47c12dc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653904:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a117436c00/0xcbde9110e47c12dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653910:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a117436c00/0xcbde9110e47c12dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653917:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a117436c00/0xcbde9110e47c12dc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653931:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a117436c00/0xcbde9110e47c12dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653937:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a117436c00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726016.653941:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a117436c00/0xcbde9110e47c12dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653948:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a117436c00/0xcbde9110e47c12dc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653967:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a117436c00/0xcbde9110e47c12dc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726016.653977:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726016.654032:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:3305:x1875614935079424:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726016.654039:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788726016.654101:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935079424:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788726016.654384:0:11657:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a117436c00/0xcbde9110e47c12dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726016.654399:0:11657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a117436c00/0xcbde9110e47c12dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726016.654407:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a117436c00/0xcbde9110e47c12dc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726017.045877:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788726017.813351:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788726017.813359:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a13adc2000 from 7 10000000:01000000:2.0:1788726017.813364:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788726017.813417:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726017.813431:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726017.813442:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726017.813469:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935079552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788726017.813540:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726017.813610:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1067f96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726017.813694:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935079552 00000100:00100000:3.0:1788726017.813703:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935079552 00000100:00100000:3.0:1788726017.813759:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788726017.813770:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:5831:x1875614935079552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726017.813784:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726017.813799:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10db71a00/0xcbde9110e47c12ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c12e3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726017.813822:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10db71a00/0xcbde9110e47c12ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c12e3 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726017.813831:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10db71a00/0xcbde9110e47c12ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c12e3 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726017.813840:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10db71a00, rc 0) 00000100:00100000:3.0:1788726017.813887:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935079552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726017.813895:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788726017.814285:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935079552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726017.814302:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c12ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726017.814311:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c12ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726017.814391:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935079680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788726017.814422:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726017.814454:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1067f96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726017.814507:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935079680 00000100:00100000:1.0:1788726017.814513:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935079680 00000100:00100000:1.0:1788726017.814551:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788726017.814560:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935079680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788726017.814824:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935079680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726017.814832:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788726017.815271:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935079680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788726017.815303:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935079808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788726017.815345:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726017.815378:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1067f96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726017.815432:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935079808 00000100:00100000:1.0:1788726017.815437:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935079808 00000100:00100000:1.0:1788726017.815470:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788726017.815478:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935079808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788726017.815636:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935079808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726017.815644:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788726017.815755:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935079808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726017.817524:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:11670:1875614935079936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788726017.817597:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726017.817639:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12affa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726017.817696:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935079936 00000100:00100000:2.0:1788726017.817703:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935079936 00000100:00100000:2.0:1788726017.817746:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788726017.817756:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:11670:x1875614935079936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788726017.818271:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:11670:x1875614935079936:12345-0@lo:502:llog_process_th.0 Request processed in 516us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726017.818280:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788726017.818422:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:11670:1875614935079936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788726017.818454:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788726017.818462:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726017.818465:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788726017.818471:0:11670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91a13adc2000 00000020:00000080:3.0:1788726017.818474:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788726017.818555:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:11670:1875614935080064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788726017.818589:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726017.818618:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12affa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726017.821479:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935080064 00000100:00100000:2.0:1788726017.821492:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935080064 00000100:00100000:2.0:1788726017.821554:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788726017.821564:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:11670:x1875614935080064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788726017.821816:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:11670:x1875614935080064:12345-0@lo:502:llog_process_th.0 Request processed in 253us (3224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726017.821824:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788726017.824013:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:11670:1875614935080064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788726017.824061:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788726017.824072:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726017.824074:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788726017.824079:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788726017.824514:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788726017.824538:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788726017.824549:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c12ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726017.824560:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c12ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726017.824572:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788726017.824575:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a10338f800 from 7 10000000:01000000:1.0:1788726017.824578:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788726017.824615:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726017.824623:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726017.824632:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726017.824655:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d32300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935080192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788726017.824727:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726017.824775:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1068f3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788726017.828032:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935080192 00000100:00100000:3.0:1788726017.828050:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935080192 00000100:00100000:3.0:1788726017.828109:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788726017.828120:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:5831:x1875614935080192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726017.828140:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726017.828160:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10db71c00/0xcbde9110e47c12f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c12f1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726017.828199:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10db71c00/0xcbde9110e47c12f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c12f1 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726017.828211:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10db71c00/0xcbde9110e47c12f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c12f1 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726017.828240:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10db71c00, rc 0) 00000100:00100000:3.0:1788726017.828325:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935080192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (3597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726017.828331:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788726017.828396:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d32300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935080192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726017.828414:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c12f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726017.828424:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c12f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726017.828494:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935080320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726017.828526:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726017.828560:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12affa480 going to sleep for 11 seconds 00000100:00100000:3.0:1788726017.828587:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935080320 00000100:00100000:3.0:1788726017.828592:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935080320 00000100:00100000:3.0:1788726017.828615:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788726017.828622:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935080320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726017.828866:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935080320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726017.828874:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788726017.828922:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935080320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726017.828951:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935080448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726017.829000:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726017.829015:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12affa480 going to sleep for 11 seconds 00000100:00100000:3.0:1788726017.829027:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935080448 00000100:00100000:3.0:1788726017.829031:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935080448 00000100:00100000:3.0:1788726017.829059:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788726017.829065:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935080448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726017.829211:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935080448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726017.829247:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788726017.829284:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935080448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726017.829454:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:11673:1875614935080576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788726017.829488:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726017.829506:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935080576 00000100:00100000:3.0:1788726017.829510:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935080576 00000100:00100000:3.0:1788726017.829531:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788726017.829537:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:11673:x1875614935080576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788726017.829661:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:11673:x1875614935080576:12345-0@lo:502:llog_process_th.0 Request processed in 123us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726017.829669:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788726017.829698:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13ab25240 going to sleep for 11 seconds 00000100:00100000:3.0:1788726017.829710:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:11673:1875614935080576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788726017.829747:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788726017.829756:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726017.829759:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788726017.829765:0:11673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91a10338f800 00000020:00000080:3.0:1788726017.829768:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788726017.829837:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:11673:1875614935080704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788726017.829870:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726017.829888:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935080704 00000100:00100000:3.0:1788726017.829898:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935080704 00000100:00100000:3.0:1788726017.829919:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788726017.829926:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:11673:x1875614935080704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788726017.830038:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:11673:x1875614935080704:12345-0@lo:502:llog_process_th.0 Request processed in 112us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726017.830045:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788726017.830072:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a107e6bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726017.830084:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:11673:1875614935080704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788726017.830100:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788726017.830104:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726017.830106:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788726017.830110:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788726017.830153:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788726017.830168:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788726017.830176:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c12f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726017.830186:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c12f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726017.830195:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788726017.830198:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a120292000 from 7 10000000:01000000:3.0:1788726017.830200:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788726017.830247:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726017.830255:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726017.830264:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726017.830284:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935080832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788726017.830308:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726017.830321:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a107e6bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726017.830402:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935080832 00000100:00100000:3.0:1788726017.830406:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935080832 00000100:00100000:3.0:1788726017.830426:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788726017.830432:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:5831:x1875614935080832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726017.830441:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726017.830452:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10db70600/0xcbde9110e47c1306 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c12ff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726017.830470:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10db70600/0xcbde9110e47c1306 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c12ff expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726017.830479:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10db70600/0xcbde9110e47c1306 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c12ff expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726017.830486:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10db70600, rc 0) 00000100:00100000:3.0:1788726017.830512:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935080832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726017.830517:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788726017.830544:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935080832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726017.830555:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1306 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726017.830564:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c1306 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726017.830606:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935080960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726017.830629:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726017.830641:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a107e6bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726017.830652:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935080960 00000100:00100000:3.0:1788726017.830655:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935080960 00000100:00100000:3.0:1788726017.830673:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788726017.830679:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935080960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726017.830861:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935080960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726017.830868:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788726017.830896:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935080960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726017.830918:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935081088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726017.830950:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726017.837767:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935081088 00000100:00100000:0.0:1788726017.837781:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935081088 00000100:00100000:0.0:1788726017.837840:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788726017.837848:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935081088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726017.847759:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a107e6bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726017.852638:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:5831:x1875614935081088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 14769us (21666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726017.852656:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788726017.853106:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:5831:1875614935081088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726017.854590:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:11674:1875614935081216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788726017.854667:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726017.854711:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13a947a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788726017.854790:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935081216 00000100:00100000:0.0:1788726017.854798:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935081216 00000100:00100000:0.0:1788726017.854843:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788726017.854853:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:11674:x1875614935081216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788726017.855105:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:11674:x1875614935081216:12345-0@lo:502:llog_process_th.0 Request processed in 253us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726017.855113:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788726017.855527:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:11674:1875614935081216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788726017.855555:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788726017.855566:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726017.855568:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788726017.855575:0:11674:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91a120292000 00000020:00000080:3.0:1788726017.855577:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788726017.855657:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:11674:1875614935081344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788726017.855700:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726017.855766:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13a947a80 going to sleep for 11 seconds 00000040:00080000:1.0:1788726017.859612:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788726017.864825:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935081344 00000100:00100000:2.0:1788726017.864841:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935081344 00000100:00100000:2.0:1788726017.864896:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788726017.864916:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:11674:x1875614935081344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788726017.865373:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:11674:x1875614935081344:12345-0@lo:502:llog_process_th.0 Request processed in 467us (9671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726017.865382:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788726017.865497:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:11674:1875614935081344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788726017.865529:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788726017.865536:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726017.865539:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788726017.865544:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788726017.865688:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788726017.865709:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788726017.865718:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1306 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726017.865730:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1306 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726018.069511:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726018.279328:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726018.279443:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914073856 00000100:00100000:2.0:1788726018.279455:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914073856 00000100:00100000:2.0:1788726018.279579:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 264 00000100:00100000:2.0:1788726018.279591:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+11:5593:x1875614914073856:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726018.279610:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726018.279629:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a117436400/0xcbde9110e47c130d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be90559fbd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726018.279655:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a117436400/0xcbde9110e47c130d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fbd expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726018.279666:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a117436400/0xcbde9110e47c130d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fbd expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726018.279675:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a117436400, rc 0) 00000100:00100000:2.0:1788726018.279744:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+12:5593:x1875614914073856:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 Request processed in 155us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726018.279751:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 264 00000100:00100000:3.0:1788726018.281623:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726018.282405:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914073984 00000100:00100000:2.0:1788726018.282416:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914073984 00000100:00100000:2.0:1788726018.282475:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 265 00000100:00100000:2.0:1788726018.282498:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+12:5593:x1875614914073984:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788726018.285185:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+12:5593:x1875614914073984:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 Request processed in 2664us (3546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726018.285202:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 265 00000100:00100000:1.0:1788726018.299713:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726018.300075:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914074112 00000100:00100000:2.0:1788726018.300087:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914074112 00000100:00100000:2.0:1788726018.300151:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 266 00000100:00100000:2.0:1788726018.300163:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+12:5593:x1875614914074112:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788726018.300446:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+12:5593:x1875614914074112:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 Request processed in 284us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726018.300454:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 266 00000100:00100000:1.0:1788726018.308367:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726018.308519:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914074240 00000100:00100000:2.0:1788726018.308532:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914074240 00000100:00100000:2.0:1788726018.308593:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 267 00000100:00100000:2.0:1788726018.308604:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+12:9942:x1875614914074240:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788726018.308877:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+12:9942:x1875614914074240:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 273us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726018.308885:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 267 00000100:00100000:3.0:1788726018.312841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726018.313018:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914074368 00000100:00100000:2.0:1788726018.313029:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914074368 00000100:00100000:2.0:1788726018.313081:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 268 00000100:00100000:2.0:1788726018.313091:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+12:9942:x1875614914074368:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788726018.313518:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+12:9942:x1875614914074368:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 425us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726018.313537:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 268 00000100:00100000:1.0:1788726018.330937:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726018.331381:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914074496 00000100:00100000:0.0:1788726018.331393:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914074496 00000100:00100000:0.0:1788726018.331493:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 269 00000100:00100000:0.0:1788726018.331504:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+12:5593:x1875614914074496:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788726018.331521:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726018.331539:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a100031800/0xcbde9110e47c1314 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be90559fc4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726018.331568:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a100031800/0xcbde9110e47c1314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fc4 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726018.331580:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a100031800/0xcbde9110e47c1314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fc4 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726018.331602:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100031800, rc 0) 00000100:00100000:0.0:1788726018.331674:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:5593:x1875614914074496:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 Request processed in 170us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726018.331700:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 269 00000100:00100000:1.0:1788726018.333970:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726018.334073:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914074624 00000100:00100000:2.0:1788726018.334084:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914074624 00000100:00100000:2.0:1788726018.334136:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 270 00000100:00100000:2.0:1788726018.334147:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:5593:x1875614914074624:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788726018.334466:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:5593:x1875614914074624:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 Request processed in 320us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726018.334474:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 270 00000100:00100000:1.0:1788726018.339112:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726018.339277:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914074752 00000100:00100000:0.0:1788726018.339287:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914074752 00000100:00100000:0.0:1788726018.339343:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 271 00000100:00100000:0.0:1788726018.339354:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:5593:x1875614914074752:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788726018.341007:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:5593:x1875614914074752:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 Request processed in 1644us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726018.341022:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 271 00000100:00100000:1.0:1788726018.354343:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726018.354520:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914074880 00000100:00100000:3.0:1788726018.354531:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914074880 00000100:00100000:3.0:1788726018.354588:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 272 00000100:00100000:3.0:1788726018.354610:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:9945:x1875614914074880:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788726018.354874:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:9945:x1875614914074880:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 265us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726018.354883:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 272 00000100:00100000:1.0:1788726018.358481:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726018.358575:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914075008 00000100:00100000:0.0:1788726018.358585:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914075008 00000100:00100000:0.0:1788726018.358648:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 273 00000100:00100000:0.0:1788726018.358659:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:9945:x1875614914075008:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788726018.359074:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:9945:x1875614914075008:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 416us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726018.359083:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 273 00000040:00080000:1.0:1788726018.902174:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788726018.981796:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726018.981848:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726018.981914:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726018.982019:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914075136 00000100:00100000:3.0:1788726018.982030:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914075136 00000100:00100000:3.0:1788726018.982097:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914075392 00000100:00100000:3.0:1788726018.982101:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914075392 00000100:00100000:3.0:1788726018.982132:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:3.0:1788726018.982142:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2350:x1875614914075136:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726018.982209:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2350:x1875614914075136:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 69us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726018.982253:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:3.0:1788726018.982269:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:3.0:1788726018.982282:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914075392:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726018.982306:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914075392:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726018.982312:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00080000:1.0:1788726018.982467:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788726018.982775:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914075264 00000100:00100000:2.0:1788726018.982781:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914075264 00000100:00100000:2.0:1788726018.982846:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:2.0:1788726018.982854:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2350:x1875614914075264:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788726018.982913:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2350:x1875614914075264:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 60us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726018.982920:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00080000:1.0:1788726018.983377:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788726019.094270:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726019.288384:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935081472:0@lo:400:kworker.0 00000100:00100000:2.0:1788726019.288448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726019.288561:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935081600:0@lo:400:kworker.0 00000100:00100000:0.0:1788726019.288588:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726019.288628:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935081600 00000100:00100000:0.0:1788726019.288635:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935081600 00000100:00100000:0.0:1788726019.288679:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788726019.288680:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935081472 00000100:00100000:3.0:1788726019.288687:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935081472 00000100:00100000:0.0:1788726019.288687:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935081600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726019.288724:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788726019.288733:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935081472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726019.288743:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935081600:12345-0@lo:400:kworker.0 Request processed in 55us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726019.288751:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788726019.288815:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935081600:0@lo:400:kworker.0 00000100:00100000:1.0:1788726019.295857:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935081856:0@lo:400:kworker.0 00000100:00100000:1.0:1788726019.295987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726019.296033:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788726019.296040:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935081728:0@lo:400:kworker.0 00000100:00100000:1.0:1788726019.296069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726019.296100:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935081856 00000100:00100000:1.0:1788726019.296108:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935081856 00000100:00100000:1.0:1788726019.296169:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788726019.296181:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935081856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726019.296267:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935081856:12345-0@lo:400:kworker.0 Request processed in 91us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726019.296275:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1788726019.296301:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726019.296313:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935082112:0@lo:400:kworker.0 00000100:00100000:1.0:1788726019.296357:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726019.296375:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788726019.296381:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935081984:0@lo:400:kworker.0 00000100:00100000:1.0:1788726019.296402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726019.296448:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935081856:0@lo:400:kworker.0 00000100:00100000:1.0:1788726019.296469:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935081984 00000100:00100000:1.0:1788726019.296473:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935081984 00000100:00100000:1.0:1788726019.296504:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788726019.296511:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935081984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726019.296546:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935081984:12345-0@lo:400:kworker.0 Request processed in 35us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726019.296553:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1788726019.296569:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726019.296585:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935081984:0@lo:400:kworker.0 00000100:00100000:0.0:1788726019.296671:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935081728 00000100:00100000:0.0:1788726019.296675:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935081728 00000100:00100000:0.0:1788726019.296715:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935082112 00000100:00100000:0.0:1788726019.296719:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935082112 00000100:00100000:0.0:1788726019.296740:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788726019.296747:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935081728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726019.296788:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935081728:12345-0@lo:400:kworker.0 Request processed in 40us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726019.296794:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788726019.296807:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788726019.296813:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875614935082112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726019.296845:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875614935082112:12345-0@lo:400:kworker.0 Request processed in 33us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726019.296851:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788726019.296887:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935082112:0@lo:400:kworker.0 00010000:00080000:0.0:1788726019.296913:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a141debb80 x1875614935081728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726019.296925:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935081728:0@lo:400:kworker.0 00000100:00080000:1.0:1788726019.297357:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788726019.297362:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788726019.309902:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935081472:12345-0@lo:400:kworker.0 Request processed in 21157us (21439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726019.309902:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935081472:0@lo:400:kworker.0 00000100:00100000:3.0:1788726019.309926:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788726019.797446:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788726019.802852:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935082240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788726019.803098:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726019.803339:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935082240 00000100:00100000:0.0:1788726019.803348:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935082240 00000100:00100000:0.0:1788726019.803394:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788726019.803403:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875614935082240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788726019.803445:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726019.803501:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875614935082240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726019.803525:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788726019.803859:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935082240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788726020.117536:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726020.821538:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788726020.821563:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935082368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788726020.821649:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726020.821797:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935082368 00000100:00100000:2.0:1788726020.821807:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935082368 00000100:00100000:2.0:1788726020.822009:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788726020.822038:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935082368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788726020.822084:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788726020.822144:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935082368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726020.822151:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788726020.824241:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1117cdf80 x1875614935082368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726020.824270:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935082368:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788726020.916767:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1788726021.141528:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726022.169860:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726023.189409:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726024.100538:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726024.100583:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726024.100624:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726024.100654:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914075648 00000100:00100000:1.0:1788726024.100659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726024.100665:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914075648 00000100:00080000:1.0:1788726024.100695:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788726024.100735:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914075904 00000100:00100000:2.0:1788726024.100739:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914075904 00000100:00100000:3.0:1788726024.100740:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914075520 00000100:00100000:3.0:1788726024.100743:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914075520 00000100:00100000:3.0:1788726024.100779:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 275 00000100:00100000:2.0:1788726024.100779:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:3.0:1788726024.100789:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2349:x1875614914075520:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788726024.100789:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2349:x1875614914075648:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788726024.100863:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2349:x1875614914075648:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 65us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726024.100866:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:2.0:1788726024.100870:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:1.0:1788726024.100876:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2349:x1875614914075904:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726024.100952:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914075776 00000100:00100000:0.0:1788726024.100957:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914075776 00000100:00100000:0.0:1788726024.100994:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:0.0:1788726024.101001:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2349:x1875614914075776:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726024.104928:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2349:x1875614914075520:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 4126us (4290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726024.104943:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 275 00000100:00080000:3.0:1788726024.105025:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788726024.105047:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726024.105632:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2349:x1875614914075904:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 4756us (5044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726024.105644:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:0.0:1788726024.106879:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2349:x1875614914075776:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 5869us (6210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726024.106893:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00010000:00010000:1.0:1788726024.213523:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726024.405968:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935082496:0@lo:400:kworker.0 00000100:00100000:2.0:1788726024.406060:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726024.406137:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935083008:0@lo:400:kworker.0 00000100:00100000:2.0:1788726024.406179:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726024.406210:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788726024.406237:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935082624:0@lo:400:kworker.0 00000100:00100000:2.0:1788726024.406260:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726024.406279:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935083136:0@lo:400:kworker.0 00000100:00100000:2.0:1788726024.406302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726024.406345:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935083008 00000100:00100000:2.0:1788726024.406353:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935083008 00000100:00100000:2.0:1788726024.406421:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935082624 00000100:00100000:2.0:1788726024.406425:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935082624 00000100:00100000:2.0:1788726024.406448:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788726024.406458:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935083008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726024.406517:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935083008:12345-0@lo:400:kworker.0 Request processed in 59us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726024.406524:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788726024.406542:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788726024.406560:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935082624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726024.406589:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935082624:12345-0@lo:400:kworker.0 Request processed in 41us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726024.406595:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788726024.406639:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935082624:0@lo:400:kworker.0 00000100:00100000:2.0:1788726024.406651:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935083008:0@lo:400:kworker.0 00000100:00100000:1.0:1788726024.406938:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935082496 00000100:00100000:1.0:1788726024.406944:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935082496 00000100:00100000:1.0:1788726024.406982:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788726024.406990:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935082496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726024.407030:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935082496:12345-0@lo:400:kworker.0 Request processed in 41us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726024.407036:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788726024.407120:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935082752:0@lo:400:kworker.0 00000100:00100000:3.0:1788726024.407154:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726024.407193:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788726024.407200:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935082880:0@lo:400:kworker.0 00000100:00100000:3.0:1788726024.407262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788726024.407287:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726024.407495:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935083136 00000100:00100000:1.0:1788726024.407501:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935083136 00000100:00100000:1.0:1788726024.407540:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935082752 00000100:00100000:1.0:1788726024.407543:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935082752 00000100:00100000:1.0:1788726024.407576:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788726024.407583:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935083136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726024.407620:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935083136:12345-0@lo:400:kworker.0 Request processed in 38us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726024.407637:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788726024.407650:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788726024.407657:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935082752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726024.407690:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935082752:12345-0@lo:400:kworker.0 Request processed in 33us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726024.407695:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788726024.407845:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935082880 00000100:00100000:2.0:1788726024.407878:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935082880 00000100:00100000:2.0:1788726024.408038:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788726024.408047:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935082880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726024.408083:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935082880:12345-0@lo:400:kworker.0 Request processed in 38us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726024.408089:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1788726024.408146:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788726024.408151:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788726024.408152:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788726024.408190:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935082880:0@lo:400:kworker.0 00010000:00080000:3.0:1788726024.408202:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a141deb800 x1875614935082752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726024.408211:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935082752:0@lo:400:kworker.0 00000100:00100000:3.0:1788726024.408268:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788726024.408274:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a13a445180, transno 4294967300 00000100:00100000:3.0:1788726024.408292:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935083136:0@lo:400:kworker.0 00000100:00100000:3.0:1788726024.408303:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935082496:0@lo:400:kworker.0 00000100:00100000:3.0:1788726024.922883:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935083264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788726024.922954:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726024.923127:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935083264 00000100:00100000:1.0:1788726024.923136:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935083264 00000100:00100000:1.0:1788726024.923199:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788726024.923210:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935083264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788726024.923275:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788726024.923330:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935083264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726024.923338:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788726024.923560:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935083264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788726025.243512:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726025.941707:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935083392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788726025.941782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726025.941985:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935083392 00000100:00100000:2.0:1788726025.942004:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935083392 00000100:00100000:2.0:1788726025.942058:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788726025.942068:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935083392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788726025.942121:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788726025.942168:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935083392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726025.942176:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788726025.942263:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1117cc000 x1875614935083392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726025.942282:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935083392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788726026.261460:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726027.286204:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788726028.118052:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788726028.311585:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726029.235454:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726029.235552:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726029.235664:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914076160 00000100:00100000:2.0:1788726029.235674:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914076160 00000100:00100000:2.0:1788726029.235758:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:2.0:1788726029.235801:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2352:x1875614914076160:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788726029.235891:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2352:x1875614914076160:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 123us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726029.235899:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00080000:0.0:1788726029.236259:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726029.237404:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914076032 00000100:00100000:3.0:1788726029.237416:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914076032 00000100:00100000:3.0:1788726029.237473:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 277 00000100:00100000:3.0:1788726029.237484:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:2352:x1875614914076032:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726029.237706:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:2352:x1875614914076032:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 222us (2261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726029.237731:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 277 00000100:00100000:2.0:1788726029.237979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726029.238172:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914076416 00000100:00100000:1.0:1788726029.238178:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914076416 00000100:00100000:1.0:1788726029.238251:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 111 00000100:00100000:1.0:1788726029.238262:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2351:x1875614914076416:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:3.0:1788726029.238276:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726029.242318:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2351:x1875614914076416:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 4043us (4334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726029.242333:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 111 00000100:00100000:2.0:1788726029.242779:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726029.242955:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914076288 00000100:00100000:1.0:1788726029.242966:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914076288 00000100:00100000:1.0:1788726029.243314:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:1.0:1788726029.243329:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914076288:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726029.243401:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914076288:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 77us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726029.243408:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00080000:3.0:1788726029.247870:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788726029.336434:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726029.525533:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935083904:0@lo:400:kworker.0 00000100:00100000:3.0:1788726029.525612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726029.525670:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788726029.525677:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935083776:0@lo:400:kworker.0 00000100:00100000:3.0:1788726029.525701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726029.525738:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935083776 00000100:00100000:3.0:1788726029.525746:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935083776 00000100:00100000:3.0:1788726029.525834:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788726029.525845:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935083776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726029.525898:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935083776:12345-0@lo:400:kworker.0 Request processed in 56us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726029.525905:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788726029.525928:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788726029.525953:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13ab48380 x1875614935083776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726029.525968:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935083776:0@lo:400:kworker.0 00000100:00100000:0.0:1788726029.526296:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935083648:0@lo:400:kworker.0 00000100:00100000:0.0:1788726029.526332:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726029.526365:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935084160:0@lo:400:kworker.0 00000100:00100000:0.0:1788726029.526387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726029.526413:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788726029.526419:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935083520:0@lo:400:kworker.0 00000100:00100000:0.0:1788726029.526446:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726029.526466:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935084032:0@lo:400:kworker.0 00000100:00100000:0.0:1788726029.526487:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726029.526688:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935084160 00000100:00100000:1.0:1788726029.526695:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935084160 00000100:00100000:1.0:1788726029.526746:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788726029.526754:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935084160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726029.526828:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935084160:12345-0@lo:400:kworker.0 Request processed in 75us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726029.526835:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788726029.526872:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935084160:0@lo:400:kworker.0 00000100:00080000:0.0:1788726029.527291:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788726029.527355:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935083904 00000100:00100000:3.0:1788726029.527362:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935083904 00000100:00100000:3.0:1788726029.527409:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935083648 00000100:00100000:3.0:1788726029.527413:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935083648 00000100:00100000:3.0:1788726029.527425:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935084032 00000100:00100000:3.0:1788726029.527428:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935084032 00000100:00100000:3.0:1788726029.527440:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788726029.527445:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935083904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726029.527507:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935083904:12345-0@lo:400:kworker.0 Request processed in 62us (1895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726029.527513:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788726029.527524:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788726029.527530:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935083648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726029.527557:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935083648:12345-0@lo:400:kworker.0 Request processed in 27us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726029.527562:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788726029.527570:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788726029.527575:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935084032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726029.527598:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935084032:12345-0@lo:400:kworker.0 Request processed in 23us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726029.527604:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788726029.527637:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935083904:0@lo:400:kworker.0 00000100:00080000:0.0:1788726029.527700:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788726029.527825:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935083520 00000100:00100000:2.0:1788726029.527830:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935083520 00000100:00100000:2.0:1788726029.527857:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788726029.527864:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935083520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726029.527895:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935083520:12345-0@lo:400:kworker.0 Request processed in 33us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726029.527900:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788726029.528265:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935083520:0@lo:400:kworker.0 00000100:00100000:1.0:1788726029.528279:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935084032:0@lo:400:kworker.0 00000100:00100000:1.0:1788726029.528290:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935083648:0@lo:400:kworker.0 00000100:00100000:3.0:1788726030.038388:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788726030.038411:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935084288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788726030.038477:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726030.038850:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935084288 00000100:00100000:2.0:1788726030.038860:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935084288 00000100:00100000:2.0:1788726030.038914:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788726030.038924:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935084288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788726030.038965:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788726030.039033:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935084288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726030.039040:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788726030.039125:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935084288:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788726030.357450:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726031.061523:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788726031.061550:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935084416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788726031.061621:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726031.061689:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935084416 00000100:00100000:2.0:1788726031.061698:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935084416 00000100:00100000:2.0:1788726031.061778:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788726031.061788:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935084416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788726031.061823:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788726031.061839:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788726031.061872:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935084416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726031.061879:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788726031.061900:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1117cfb80 x1875614935084416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726031.061923:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935084416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788726031.382011:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726032.406201:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726033.429438:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726034.348924:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726034.348990:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726034.349035:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914076544 00000100:00100000:0.0:1788726034.349046:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914076544 00000100:00100000:0.0:1788726034.349130:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 279 00000100:00100000:0.0:1788726034.349141:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:2352:x1875614914076544:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726034.349278:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:2352:x1875614914076544:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 138us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726034.349285:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 279 00000100:00100000:1.0:1788726034.349428:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914076672 00000100:00100000:1.0:1788726034.349439:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914076672 00000100:00100000:1.0:1788726034.349493:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:1.0:1788726034.349504:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2352:x1875614914076672:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:0.0:1788726034.349709:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726034.353411:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2352:x1875614914076672:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 3897us (4407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726034.353426:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:3.0:1788726034.372803:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726034.372850:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726034.372960:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914076800 00000100:00100000:0.0:1788726034.372970:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914076800 00000100:00100000:0.0:1788726034.373048:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:0.0:1788726034.373060:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2348:x1875614914076800:12345-192.168.201.42@tcp:9:kworker.0 00000020:00000080:0.0:1788726034.373089:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c1250 00000100:00080000:0.0:1788726034.373098:0:6680:0:(import.c:65:import_set_state_nolock()) ffff91a13a56d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788726034.373138:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788726034.373448:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+2:2348:x1875614914076800:12345-192.168.201.42@tcp:9:kworker.0 Request processed in 390us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726034.373457:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00010000:00010000:0.0:1788726034.373475:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788726034.373868:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788726034.374607:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914076928 00000100:00100000:2.0:1788726034.374617:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914076928 00000100:00100000:2.0:1788726034.374696:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:2.0:1788726034.374706:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2351:x1875614914076928:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788726034.374780:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2351:x1875614914076928:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 76us (1987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726034.374787:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00080000:3.0:1788726034.374889:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788726034.454184:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726034.646570:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935084544:0@lo:400:kworker.0 00000100:00100000:2.0:1788726034.646649:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726034.646718:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935084544 00000100:00100000:1.0:1788726034.646726:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935084544 00000100:00100000:1.0:1788726034.646786:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788726034.646814:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788726034.646821:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935084672:0@lo:400:kworker.0 00000100:00100000:1.0:1788726034.646878:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935084544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726034.646943:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935084544:12345-0@lo:400:kworker.0 Request processed in 70us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726034.646950:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788726034.647505:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726034.647597:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935084544:0@lo:400:kworker.0 00000100:00100000:0.0:1788726034.647766:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935084928:0@lo:400:kworker.0 00000100:00100000:0.0:1788726034.647797:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726034.647835:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935085056:0@lo:400:kworker.0 00000100:00100000:2.0:1788726034.647885:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935085184:0@lo:400:kworker.0 00000100:00100000:2.0:1788726034.647911:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726034.648107:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935085184 00000100:00100000:1.0:1788726034.648114:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935085184 00000100:00100000:1.0:1788726034.648167:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788726034.648176:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935085184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726034.648238:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935085184:12345-0@lo:400:kworker.0 Request processed in 63us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726034.648244:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788726034.648268:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935084800:0@lo:400:kworker.0 00000100:00100000:1.0:1788726034.648292:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726034.648330:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935084800 00000100:00100000:1.0:1788726034.648334:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935084800 00000100:00100000:1.0:1788726034.648357:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788726034.648364:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935084800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726034.648424:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935084800:12345-0@lo:400:kworker.0 Request processed in 61us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726034.648430:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1788726034.648460:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a447800 x1875614935084800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726034.648473:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935084800:0@lo:400:kworker.0 00000100:00080000:2.0:1788726034.649028:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788726034.649034:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788726034.649058:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935085184:0@lo:400:kworker.0 00000100:00100000:2.0:1788726034.649512:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726034.649583:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935084672 00000100:00100000:3.0:1788726034.649591:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935084672 00000100:00100000:3.0:1788726034.649636:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935084928 00000100:00100000:3.0:1788726034.649639:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935084928 00000100:00100000:3.0:1788726034.649671:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788726034.649689:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935084672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726034.649742:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935084672:12345-0@lo:400:kworker.0 Request processed in 54us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726034.649749:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788726034.649762:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788726034.649769:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935084928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726034.649798:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935084928:12345-0@lo:400:kworker.0 Request processed in 30us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726034.649804:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1788726034.649821:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726034.650068:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935084928:0@lo:400:kworker.0 00000100:00100000:2.0:1788726034.650265:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935084672:0@lo:400:kworker.0 00000100:00100000:1.0:1788726034.650325:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935085056 00000100:00100000:1.0:1788726034.650330:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935085056 00000100:00080000:2.0:1788726034.650399:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726034.650506:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788726034.650515:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935085056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726034.650623:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935085056:12345-0@lo:400:kworker.0 Request processed in 110us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726034.650630:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788726034.650742:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935085056:0@lo:400:kworker.0 00000100:00100000:1.0:1788726035.157463:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935085312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788726035.157565:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726035.157732:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935085312 00000100:00100000:2.0:1788726035.157742:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935085312 00000100:00100000:2.0:1788726035.157801:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788726035.157811:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935085312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788726035.157852:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788726035.157914:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935085312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726035.157922:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788726035.158006:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935085312:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788726035.477433:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726036.187599:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788726036.187622:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935085440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788726036.187702:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726036.188094:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935085440 00000100:00100000:1.0:1788726036.188103:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935085440 00000100:00100000:1.0:1788726036.188163:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788726036.188173:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935085440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788726036.188210:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788726036.188333:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788726036.196946:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935085440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8767us (9235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726036.196962:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788726036.197013:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1117cdf80 x1875614935085440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726036.197046:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935085440:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788726036.244367:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000020:00000080:1.0:1788726036.244376:0:7632:0:(genops.c:885:class_export_put()) final put ffff91a13a56a000/7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000020:00000080:3.0:1788726036.244427:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13a56a000/7c11f8bd-dcce-4bc6-a067-83d611fb0a24 for lustre-OST0001 00000020:00000080:3.0:1788726036.244467:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a13a56d800 for lustre-OST0001 00010000:00010000:2.0:1788726036.501733:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726037.531677:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788726038.361401:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788726038.549331:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726039.473479:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726039.473572:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914077184 00000100:00100000:0.0:1788726039.473583:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914077184 00000100:00100000:0.0:1788726039.473670:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:0.0:1788726039.473680:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2349:x1875614914077184:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726039.473769:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2349:x1875614914077184:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 90us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726039.473791:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00080000:2.0:1788726039.473806:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726039.483239:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726039.483283:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726039.483321:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914077056 00000100:00100000:0.0:1788726039.483330:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914077056 00000100:00100000:0.0:1788726039.483381:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 281 00000100:00100000:0.0:1788726039.483391:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a108974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2350:x1875614914077056:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726039.483458:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a108974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2350:x1875614914077056:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 68us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726039.483466:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 281 00000100:00100000:0.0:1788726039.483509:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914077312 00000100:00100000:0.0:1788726039.483514:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914077312 00000100:00100000:0.0:1788726039.483552:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:0.0:1788726039.483559:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914077312:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726039.483602:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914077312:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 33us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726039.483609:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00080000:0.0:1788726039.483633:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788726039.573397:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726039.765566:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935085824:0@lo:400:kworker.0 00000100:00100000:1.0:1788726039.765649:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726039.765746:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935085696:0@lo:400:kworker.0 00000100:00100000:0.0:1788726039.765781:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726039.765807:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788726039.765813:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935085568:0@lo:400:kworker.0 00000100:00100000:0.0:1788726039.765841:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726039.765900:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935085696 00000100:00100000:0.0:1788726039.765908:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935085696 00000100:00100000:0.0:1788726039.765971:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788726039.765979:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935085696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726039.766031:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935085696:12345-0@lo:400:kworker.0 Request processed in 53us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726039.766038:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788726039.766095:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935085696:0@lo:400:kworker.0 00000100:00100000:0.0:1788726039.766133:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935085824 00000100:00100000:0.0:1788726039.766137:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935085824 00000100:00100000:0.0:1788726039.766173:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788726039.766180:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935085824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726039.767541:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935085568 00000100:00100000:3.0:1788726039.767552:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935085568 00000100:00100000:3.0:1788726039.767604:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788726039.767613:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935085568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726039.767671:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935085568:12345-0@lo:400:kworker.0 Request processed in 60us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726039.767678:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:3.0:1788726039.767722:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788726039.767747:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935085568:0@lo:400:kworker.0 00000100:00100000:3.0:1788726039.769653:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935085952:0@lo:400:kworker.0 00000100:00100000:3.0:1788726039.769717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726039.769795:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935085952 00000100:00100000:3.0:1788726039.769803:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935085952 00000100:00100000:3.0:1788726039.769870:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788726039.769880:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935085952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726039.769930:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935085952:12345-0@lo:400:kworker.0 Request processed in 52us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726039.769937:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1788726039.769958:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726039.769988:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935085952:0@lo:400:kworker.0 00000100:00100000:0.0:1788726039.770707:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935085824:12345-0@lo:400:kworker.0 Request processed in 4524us (5055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726039.770717:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788726039.773817:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935086208:0@lo:400:kworker.0 00000100:00100000:0.0:1788726039.773910:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726039.773958:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788726039.773965:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935086080:0@lo:400:kworker.0 00000100:00100000:0.0:1788726039.773990:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726039.774018:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935086080 00000100:00100000:0.0:1788726039.774025:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935086080 00000100:00100000:0.0:1788726039.774090:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788726039.774099:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935086080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726039.774149:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935086080:12345-0@lo:400:kworker.0 Request processed in 51us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726039.774156:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788726039.774201:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935086080:0@lo:400:kworker.0 00000100:00100000:2.0:1788726039.774490:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935086208 00000100:00100000:2.0:1788726039.774495:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935086208 00000100:00100000:2.0:1788726039.774534:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788726039.774541:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935086208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726039.774583:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935086208:12345-0@lo:400:kworker.0 Request processed in 43us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726039.774600:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788726039.774625:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935086208:0@lo:400:kworker.0 00000100:00080000:3.0:1788726039.774835:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788726039.774841:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788726039.775252:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13ab48a80 x1875614935085824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726039.775278:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935085824:0@lo:400:kworker.0 00000100:00100000:3.0:1788726040.278247:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788726040.278929:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935086336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788726040.279768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726040.283122:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935086336 00000100:00100000:2.0:1788726040.283143:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935086336 00000100:00100000:2.0:1788726040.283227:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788726040.283238:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935086336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788726040.283278:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788726040.283388:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935086336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (3622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726040.283395:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788726040.283859:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935086336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788726040.597483:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726041.302286:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788726041.302542:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935086464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788726041.302763:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726041.304322:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935086464 00000100:00100000:0.0:1788726041.304334:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935086464 00000100:00100000:0.0:1788726041.304397:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788726041.304408:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935086464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788726041.304446:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726041.304511:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935086464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726041.304519:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788726041.305532:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788726041.316473:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a445180 x1875614935086464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726041.316504:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935086464:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788726041.490017:0:11841:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:20:39 (1788726039) 00010000:00010000:0.0:1788726041.621404:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726042.645477:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726043.670210:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726043.715799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726043.715980:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914077440 00000100:00100000:3.0:1788726043.715991:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914077440 00000100:00100000:3.0:1788726043.716080:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:3.0:1788726043.716093:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:10215:x1875614914077440:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726043.716114:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726043.716139:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a200/0xcbde9110e47c131b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559fcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726043.716208:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1322 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726043.716248:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726043.716263:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726043.716300:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788726043.716305:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788726043.716344:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726043.716387:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a200/0xcbde9110e47c131b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fcb expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726043.716688:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1322 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fcb expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726043.716698:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639600) 00010000:00010000:3.0:1788726043.716701:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788726043.716705:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10149a800, rc 0) 00000100:00100000:3.0:1788726043.716905:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:10215:x1875614914077440:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 814us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726043.716913:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00080000:0.0:1788726043.716976:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726043.747497:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726043.747608:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914077568 00000100:00100000:2.0:1788726043.747618:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914077568 00000100:00100000:2.0:1788726043.747666:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:2.0:1788726043.747673:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:10216:x1875614914077568:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726043.747690:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726043.747721:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c1329 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559fd2 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.747804:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1330 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.747815:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1330 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.747823:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1330 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.747832:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c1337 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.747837:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c1337 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.747840:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c1337 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748024:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437a00/0xcbde9110e47c133e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748032:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437a00/0xcbde9110e47c133e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748039:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437a00/0xcbde9110e47c133e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726043.748065:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788726043.748067:0:7629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726043.748085:0:7629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437a00/0xcbde9110e47c133e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748101:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1330 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748107:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1330 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748113:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1330 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748119:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a117437c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726043.748123:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1330 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748131:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1330 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748144:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639600) 00010000:00010000:2.0:1788726043.748147:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726043.748153:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1330 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748159:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1330 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748173:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c1337 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748179:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c1337 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748184:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c1337 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748195:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a117436e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726043.748199:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c1337 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748205:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c1337 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748259:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91a11214cb00) 00010000:00010000:2.0:1788726043.748261:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726043.748264:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c1337 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748268:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c1337 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748293:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c1329 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fd2 expref: 8 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748301:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437a00/0xcbde9110e47c133e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fd2 expref: 7 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726043.748306:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91a11214c200) 00010000:00010000:2.0:1788726043.748308:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788726043.748309:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a117437a00, rc 0) 00000100:00100000:2.0:1788726043.748361:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:10216:x1875614914077568:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 689us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726043.748366:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:2.0:1788726043.762828:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726043.762951:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914077824 00000100:00100000:1.0:1788726043.762962:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914077824 00000100:00100000:1.0:1788726043.763037:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:1.0:1788726043.763048:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:10216:x1875614914077824:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788726043.763071:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726043.763105:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1345 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559fd9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.763178:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c134c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.763192:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c134c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.763203:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c134c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.763281:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1353 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.763288:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1353 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.763301:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1353 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.763932:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921e00/0xcbde9110e47c135a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.763943:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921e00/0xcbde9110e47c135a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.763951:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921e00/0xcbde9110e47c135a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726043.763961:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788726043.764289:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c134c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.764299:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c134c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.764306:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c134c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.764312:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726043.764316:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c134c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.764323:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c134c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.764335:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91a11214c200) 00010000:00010000:1.0:1788726043.764338:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726043.764349:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c134c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.764355:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c134c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.764369:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1353 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.764375:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1353 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.764381:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1353 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.764387:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726043.764689:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1353 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.764697:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1353 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.764706:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91a10d14d700) 00010000:00010000:1.0:1788726043.764709:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726043.764721:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1353 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.764728:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1353 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.765966:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1345 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fd9 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.766014:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921e00/0xcbde9110e47c135a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fd9 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726043.766023:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:1.0:1788726043.766026:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726043.766029:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921e00, rc 0) 00000100:00100000:1.0:1788726043.766119:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:10216:x1875614914077824:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 3072us (3298us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788726043.766129:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:1.0:1788726043.771989:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726043.772352:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914077952 00000100:00100000:2.0:1788726043.772363:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914077952 00000100:00100000:2.0:1788726043.773627:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:2.0:1788726043.773644:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:10216:x1875614914077952:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788726043.773950:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:10216:x1875614914077952:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 312us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726043.773956:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00000040:00080000:1.0:1788726044.507087:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788726044.581282:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726044.581351:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726044.581383:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726044.581638:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914078336 00000100:00100000:1.0:1788726044.581649:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914078336 00000100:00100000:0.0:1788726044.581649:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914078080 00000100:00100000:0.0:1788726044.581653:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914078080 00000100:00100000:1.0:1788726044.581710:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914078208 00000100:00100000:1.0:1788726044.581714:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914078208 00000100:00100000:1.0:1788726044.581741:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:1.0:1788726044.581752:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2351:x1875614914078336:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726044.581781:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:0.0:1788726044.581791:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2351:x1875614914078208:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726044.581988:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 283 00000100:00100000:3.0:1788726044.581995:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:2351:x1875614914078080:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726044.582051:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2351:x1875614914078208:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 262us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726044.582060:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:1.0:1788726044.586788:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2351:x1875614914078336:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 5022us (5420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726044.586806:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00080000:1.0:1788726044.586867:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726044.589479:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:2351:x1875614914078080:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 7472us (8194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726044.589495:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 283 00010000:00010000:3.0:1788726044.708038:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726044.891373:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a8ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935086720:0@lo:400:kworker.0 00000100:00100000:0.0:1788726044.891445:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726044.891512:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a8ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935087232:0@lo:400:kworker.0 00000100:00100000:0.0:1788726044.891539:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726044.891580:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788726044.891586:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935086592:0@lo:400:kworker.0 00000100:00100000:0.0:1788726044.891617:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726044.891638:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a8eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935087104:0@lo:400:kworker.0 00000100:00100000:0.0:1788726044.891658:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726044.891688:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935086720 00000100:00100000:0.0:1788726044.891696:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935086720 00000100:00100000:0.0:1788726044.891737:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935087104 00000100:00100000:0.0:1788726044.891740:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935087104 00000100:00100000:0.0:1788726044.891772:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788726044.891780:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935086720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726044.891834:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935086720:12345-0@lo:400:kworker.0 Request processed in 55us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726044.891841:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788726044.891856:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788726044.891863:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935087104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726044.891890:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935087104:12345-0@lo:400:kworker.0 Request processed in 28us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726044.891897:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788726044.891913:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935087232 00000100:00100000:0.0:1788726044.891916:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935087232 00000100:00100000:0.0:1788726044.891944:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788726044.891951:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935087232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726044.891980:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935087232:12345-0@lo:400:kworker.0 Request processed in 30us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726044.891986:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788726044.892003:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935086592 00000100:00100000:0.0:1788726044.892013:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935086592 00000100:00100000:0.0:1788726044.892038:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788726044.892045:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935086592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726044.892075:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935086592:12345-0@lo:400:kworker.0 Request processed in 32us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726044.892082:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:0.0:1788726044.892112:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788726044.892116:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726044.892149:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935086592:0@lo:400:kworker.0 00000100:00100000:0.0:1788726044.892162:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a8eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935087104:0@lo:400:kworker.0 00000100:00100000:0.0:1788726044.892170:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a8ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935086720:0@lo:400:kworker.0 00000100:00100000:0.0:1788726044.892178:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a8ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935087232:0@lo:400:kworker.0 00000100:00100000:1.0:1788726044.892329:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935086848:0@lo:400:kworker.0 00000100:00100000:1.0:1788726044.892359:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726044.892394:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788726044.892401:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935086976:0@lo:400:kworker.0 00000100:00100000:1.0:1788726044.892434:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726044.892458:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935086976 00000100:00100000:1.0:1788726044.892462:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935086976 00000100:00100000:1.0:1788726044.892493:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788726044.892511:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935086976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726044.892547:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935086976:12345-0@lo:400:kworker.0 Request processed in 48us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726044.892553:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1788726044.892569:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726044.892586:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935086976:0@lo:400:kworker.0 00000100:00100000:0.0:1788726044.893028:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935086848 00000100:00100000:0.0:1788726044.893033:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935086848 00000100:00100000:0.0:1788726044.893083:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788726044.893091:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935086848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726044.893133:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935086848:12345-0@lo:400:kworker.0 Request processed in 43us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726044.893139:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1788726044.893167:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13a8efb80 x1875614935086848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726044.893178:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935086848:0@lo:400:kworker.0 00000100:00080000:1.0:1788726044.893246:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788726045.399067:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935087360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788726045.399138:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726045.399290:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935087360 00000100:00100000:0.0:1788726045.399299:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935087360 00000100:00100000:0.0:1788726045.399352:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788726045.399385:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935087360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788726045.399422:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726045.399469:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935087360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726045.399475:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788726045.405174:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935087360:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788726045.720051:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726045.767326:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726045.767416:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914078464 00000100:00100000:0.0:1788726045.767428:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914078464 00000100:00100000:0.0:1788726045.767528:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:0.0:1788726045.767539:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:10258:x1875614914078464:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726045.767563:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726045.767585:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1368 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559fe0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767653:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c136f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767667:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c136f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767678:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c136f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767691:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1376 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767697:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1376 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767702:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1376 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767912:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c136f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767919:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c136f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767925:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c136f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767931:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726045.767935:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c136f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767942:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c136f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767953:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639600) 00010000:00010000:0.0:1788726045.767956:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726045.767960:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c136f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767965:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c136f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767978:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1376 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767984:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1376 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.767990:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1376 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.768001:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726045.768004:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1376 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.768010:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1376 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.768017:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91a12bdfe500) 00010000:00010000:0.0:1788726045.768020:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726045.768022:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1376 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.768028:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1376 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.768063:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1368 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fe0 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.768072:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639600) 00010000:00010000:0.0:1788726045.768074:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726045.768078:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1368 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fe0 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.768088:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100031c00, rc 0) 00000100:00100000:0.0:1788726045.768149:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:10258:x1875614914078464:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 612us (836us total) trans 0 rc 301/301 00000100:00100000:0.0:1788726045.768157:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00080000:2.0:1788726045.768551:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788726045.777789:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726045.777875:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914078720 00000100:00100000:0.0:1788726045.777896:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914078720 00000100:00100000:0.0:1788726045.777959:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:0.0:1788726045.777970:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:10258:x1875614914078720:12345-192.168.201.42@tcp:36:lfs.0 00010000:00010000:0.0:1788726045.778028:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726045.778055:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1322 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fcb expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.778075:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639600) 00010000:00010000:0.0:1788726045.778087:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788726045.778554:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c137d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.778571:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c137d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.778582:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c137d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.778594:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1384 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.778601:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1384 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.778607:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1384 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726045.780719:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788726045.780737:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c137d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.780747:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c137d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.780763:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c137d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.780769:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726045.780774:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c137d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.780781:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c137d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.780796:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a12bdfe500) 00010000:00010000:0.0:1788726045.780799:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726045.780803:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c137d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726045.780810:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c137d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788726045.780829:0:7629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfab1376 reply state 00000000a0711503 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1384 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726045.780837:0:7629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788726045.780963:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:10258:x1875614914078720:12345-192.168.201.42@tcp:36:lfs.0 Request processed in 2991us (3182us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788726045.780972:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00010000:00010000:2.0:1788726045.786510:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1384 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726045.786530:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1384 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726045.786538:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1384 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726045.786545:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726045.786550:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1384 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726045.786558:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1384 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726045.786576:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91a12bdfec00) 00010000:00010000:2.0:1788726045.786579:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726045.786583:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1384 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726045.786605:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1384 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726045.922432:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726045.922473:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914078848 00000100:00100000:3.0:1788726045.922491:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914078848 00000100:00100000:3.0:1788726045.922556:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:3.0:1788726045.922566:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:10266:x1875614914078848:12345-192.168.201.42@tcp:101:lctl.0 00010000:00010000:3.0:1788726045.922590:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726045.922615:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c138b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559fe7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726045.922690:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a200/0xcbde9110e47c1392 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726045.922711:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a200/0xcbde9110e47c1392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726045.922723:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a200/0xcbde9110e47c1392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726045.922762:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788726045.922765:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788726045.922804:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a200/0xcbde9110e47c1392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726045.922840:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c138b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fe7 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726045.922858:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a200/0xcbde9110e47c1392 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fe7 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726045.922865:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639200) 00010000:00010000:3.0:1788726045.922868:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788726045.922872:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10149a200, rc 0) 00000100:00100000:3.0:1788726045.922927:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:10266:x1875614914078848:12345-192.168.201.42@tcp:101:lctl.0 Request processed in 363us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726045.922940:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:0.0:1788726046.012932:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726046.012996:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914078976 00000100:00100000:2.0:1788726046.013005:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914078976 00000100:00100000:2.0:1788726046.013119:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:2.0:1788726046.013130:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:10272:x1875614914078976:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788726046.013152:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726046.013173:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1399 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559fee expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013547:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c13a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013571:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c13a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013584:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c13a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013709:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c13a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013718:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c13a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013726:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c13a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013832:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c13ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013854:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c13ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013861:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c13ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726046.013889:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788726046.013893:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726046.013932:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c13ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013944:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c13a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013949:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c13a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013954:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c13a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013957:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a117436e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726046.013960:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c13a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013964:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c13a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013975:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639200) 00010000:00010000:2.0:1788726046.013977:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726046.013980:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c13a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.013992:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436e00/0xcbde9110e47c13a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.014002:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c13a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.014005:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c13a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.014009:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c13a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.014012:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a117436800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726046.014014:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c13a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.014162:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c13a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.014168:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91a11214c300) 00010000:00010000:2.0:1788726046.014169:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726046.014171:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c13a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.014175:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a117436800/0xcbde9110e47c13a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.014201:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437c00/0xcbde9110e47c1399 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fee expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.014211:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c13ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fee expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.014257:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:2.0:1788726046.014260:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788726046.014262:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ebc00, rc 0) 00000100:00100000:2.0:1788726046.014331:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:10272:x1875614914078976:12345-192.168.201.42@tcp:101:bash.0 Request processed in 1202us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726046.014339:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:3.0:1788726046.017818:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726046.018029:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914079232 00000100:00100000:0.0:1788726046.018039:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914079232 00000100:00100000:0.0:1788726046.018102:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:0.0:1788726046.018112:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:10272:x1875614914079232:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788726046.018145:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726046.018164:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c13b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559ff5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.018311:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c13bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.018325:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c13bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.018335:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c13bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.018383:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.018391:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.018398:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788726046.018973:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788726046.019135:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c13ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.019145:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c13ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.019153:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c13ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.019194:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c13bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.019200:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c13bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.019206:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c13bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.019212:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726046.019247:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c13bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.019255:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c13bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.019266:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726046.019269:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726046.019273:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c13bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.019279:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c13bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788726046.019292:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6af0461 reply state 0000000003eac76e transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726046.019302:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788726046.019329:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c13b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ff5 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.019355:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c13ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ff5 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.019362:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe500) 00010000:00010000:0.0:1788726046.019364:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788726046.019366:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100030200, rc 0) 00000100:00100000:0.0:1788726046.020422:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:10272:x1875614914079232:12345-192.168.201.42@tcp:101:bash.0 Request processed in 2303us (2608us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788726046.020434:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00010000:00010000:0.0:1788726046.022202:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.022237:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.022245:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.022251:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726046.022256:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.022262:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.022276:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a12bdfe600) 00010000:00010000:0.0:1788726046.022278:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726046.022282:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.022299:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726046.025596:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726046.025754:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914079360 00000100:00100000:0.0:1788726046.025767:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914079360 00000100:00100000:0.0:1788726046.025824:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:0.0:1788726046.025834:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875614914079360:12345-192.168.201.42@tcp:8:bash.0 00010000:00080000:0.0:1788726046.025869:0:9742:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp t0 exp 0000000000000000 cur 341 last 0 00000020:00000080:0.0:1788726046.025908:0:9742:0:(genops.c:1385:class_connect()) connect: client 7c11f8bd-dcce-4bc6-a067-83d611fb0a24, cookie 0xcbde9110e47c13d8 00002000:00100000:0.0:1788726046.025920:0:9742:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7c11f8bd-dcce-4bc6-a067-83d611fb0a24/ffff91a104c7b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788726046.025945:0:9742:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:0.0:1788726046.026175:0:9742:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788726046.026205:0:9742:0:(import.c:65:import_set_state_nolock()) ffff91a104c79800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788726046.026307:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2348:x1875614914079360:12345-192.168.201.42@tcp:8:bash.0 Request processed in 472us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726046.026316:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:3.0:1788726046.029836:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726046.029983:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914079488 00000100:00100000:0.0:1788726046.029995:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914079488 00000100:00100000:0.0:1788726046.030069:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:0.0:1788726046.030080:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:0:x1875614914079488:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788726046.030098:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1788726046.030122:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788726046.030123:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c13df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be90559ffc expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726046.030151:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726046.030184:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:0.0:1788726046.030189:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726046.030199:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c13df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ffc expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.030259:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c13df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ffc expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.030274:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100031000, rc 0) 00000100:00100000:0.0:1788726046.030336:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:0:x1875614914079488:12345-192.168.201.42@tcp:101:bash.0 Request processed in 257us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726046.030343:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:1.0:1788726046.033449:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726046.033557:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914079616 00000100:00100000:0.0:1788726046.033568:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914079616 00000100:00100000:0.0:1788726046.033642:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:0.0:1788726046.033653:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:10272:x1875614914079616:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788726046.033671:0:9742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726046.033689:0:9742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a003 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.033730:0:9742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c13df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ffc expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.033747:0:9742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726046.033752:0:9742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726046.033757:0:9742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 8 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.033806:0:9742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c13df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ffc expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.033819:0:9742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c13df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ffc expref: 8 pid: 6680 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726046.033834:0:9742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a8ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9742:1875614935087488:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726046.034013:0:9742:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10337bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726046.039099:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726046.039159:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914079744 00000100:00100000:3.0:1788726046.039167:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914079744 00010000:00010000:3.0:1788726046.039200:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c13df lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ffc expref: 9 pid: 6680 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726046.039251:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:3.0:1788726046.039260:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2350:x1875614914079744:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726046.039275:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726046.039301:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c13df lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ffc expref: 9 pid: 6680 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.039328:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c13df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ffc expref: 9 pid: 6680 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.039358:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726046.039363:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726046.039371:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 9 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.039381:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 9 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.039432:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 9 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726046.039444:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111615f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875614935087616:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788726046.039573:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1068f8840 going to sleep for 11 seconds 00010000:00010000:0.0:1788726046.039777:0:9742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c13df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ffc expref: 9 pid: 6680 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726046.039795:0:9742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a8ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9742:1875614935087488:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726046.039821:0:9742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 8 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.039899:0:9742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100031c00, rc 0) 00000100:00100000:0.0:1788726046.039929:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:10272:x1875614914079616:12345-192.168.201.42@tcp:101:bash.0 Request processed in 6278us (6490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726046.039937:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:3.0:1788726046.043897:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111615f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875614935087616:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788726046.043930:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726046.044188:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726046.044271:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914080000 00000100:00100000:3.0:1788726046.044278:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914080000 00000100:00100000:3.0:1788726046.044344:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:3.0:1788726046.044354:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:10272:x1875614914080000:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:2.0:1788726046.044884:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2350:x1875614914079744:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 5623us (5791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726046.044895:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:2.0:1788726046.046294:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:10272:x1875614914080000:12345-192.168.201.42@tcp:35:bash.0 Request processed in 1860us (2026us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788726046.046306:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:1.0:1788726046.111052:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726046.111757:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914080256 00000100:00100000:0.0:1788726046.111769:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914080256 00000100:00100000:0.0:1788726046.111875:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:0.0:1788726046.111885:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:10282:x1875614914080256:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726046.111922:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726046.111941:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a00a expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726046.112029:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788726046.112147:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a00a expref: 16 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.112162:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639200) 00010000:00010000:0.0:1788726046.112165:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788726046.112170:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a00a expref: 16 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.112187:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100031000, rc 0) 00000100:00100000:0.0:1788726046.112334:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:10282:x1875614914080256:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 450us (1291us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1788726046.112342:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:1.0:1788726046.116181:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726046.116314:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914080512 00000100:00100000:3.0:1788726046.116325:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914080512 00000100:00100000:3.0:1788726046.116388:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788726046.116399:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:10282:x1875614914080512:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788726046.116707:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:10282:x1875614914080512:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 308us (535us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788726046.116714:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788726046.185690:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726046.185827:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914080640 00000100:00100000:0.0:1788726046.185838:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914080640 00000100:00100000:0.0:1788726046.185929:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:0.0:1788726046.185939:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:10288:x1875614914080640:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726046.185964:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726046.185983:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a011 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.186047:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1402 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.186077:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.186089:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726046.186124:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788726046.186127:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788726046.186144:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.186170:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c13fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a011 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.186189:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1402 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a011 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.186198:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726046.186201:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788726046.186205:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100030a00, rc 0) 00000100:00100000:0.0:1788726046.186334:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+17:10288:x1875614914080640:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 395us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726046.186342:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:1.0:1788726046.192797:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726046.193960:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914080896 00000100:00100000:2.0:1788726046.193974:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914080896 00000100:00100000:2.0:1788726046.194096:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:2.0:1788726046.194107:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+17:10288:x1875614914080896:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726046.194130:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726046.194152:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1409 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a018 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.194283:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1410 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.194297:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.194342:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726046.194354:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788726046.194939:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1409 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a018 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.194963:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a018 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.194971:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe500) 00010000:00010000:2.0:1788726046.194974:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726046.194977:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eae00, rc 0) 00000100:00100000:2.0:1788726046.195058:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:10288:x1875614914080896:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 952us (2270us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788726046.195067:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:1.0:1788726046.201022:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726046.201070:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726046.201249:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914081152 00000100:00100000:0.0:1788726046.201260:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914081152 00000100:00100000:0.0:1788726046.201322:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:0.0:1788726046.201333:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:10288:x1875614914081152:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726046.201358:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726046.201391:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c141e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a01f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.201495:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1425 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.201510:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1425 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.201523:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1425 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726046.201535:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:3.0:1788726046.201839:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914081280 00000100:00100000:3.0:1788726046.201845:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914081280 00000100:00100000:3.0:1788726046.201883:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:3.0:1788726046.201890:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:2350:x1875614914081280:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726046.201909:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726046.201926:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1410 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a018 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.201942:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe500) 00010000:00010000:3.0:1788726046.201947:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726046.202001:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:2350:x1875614914081280:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 111us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726046.202008:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00010000:00010000:0.0:1788726046.202116:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c141e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a01f expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.202133:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1425 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a01f expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.202141:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe500) 00010000:00010000:0.0:1788726046.202144:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788726046.202147:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100030400, rc 0) 00000100:00100000:0.0:1788726046.202173:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:10288:x1875614914081152:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 842us (1102us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788726046.202179:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:3.0:1788726046.213545:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726046.213936:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914081408 00000100:00100000:0.0:1788726046.213948:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914081408 00000100:00100000:0.0:1788726046.214009:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:0.0:1788726046.214020:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2351:x1875614914081408:12345-192.168.201.42@tcp:1:lfs.0 00010000:00010000:0.0:1788726046.214085:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c1433 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.214107:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 7 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.214116:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726046.214120:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788726046.214125:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c1433 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.214160:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 7 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.214175:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 7 pid: 9742 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726046.214190:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a8ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875614935087744:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726046.214299:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10337b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788726046.217532:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a8ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875614935087744:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726046.217572:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c1433 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726046.219810:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726046.220336:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914081536 00000100:00100000:0.0:1788726046.220348:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914081536 00002000:00100000:0.0:1788726046.220399:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff91a13a9f5180 x1875614914081536/t0(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:442/0 lens 504/0 e 0 to 0 dl 1788726057 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788726046.220423:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13a9f5180 with x1875614914081536 ext(0->12) 00010000:00010000:0.0:1788726046.220433:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 8 pid: 9742 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.220450:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 8 pid: 9742 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726046.220459:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91a13a9f5180 00000100:00100000:0.0:1788726046.220505:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:0.0:1788726046.220515:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2349:x1875614914081536:12345-192.168.201.42@tcp:4:lfs.0 00000001:00100000:2.0:1788726046.261093:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000100:00100000:1.0:1788726046.262466:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2349:x1875614914081536:12345-192.168.201.42@tcp:4:lfs.0 Request processed in 41944us (42659us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788726046.262495:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00002000:00100000:1.0:1788726046.262512:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff91a13a9f5180 x1875614914081536/t4294967299(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:442/0 lens 504/448 e 0 to 0 dl 1788726057 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788726046.262540:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13a9f5180 with x1875614914081536 ext(0->12) 00010000:00010000:1.0:1788726046.262564:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 9 pid: 9742 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.262666:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 9 pid: 9742 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788726046.262675:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91a13a9f5180 00000100:00100000:3.0:1788726046.266583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726046.266861:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914081664 00000100:00100000:0.0:1788726046.266872:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914081664 00010000:00010000:0.0:1788726046.266914:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 9 pid: 9742 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726046.266963:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:0.0:1788726046.266975:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2352:x1875614914081664:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726046.266989:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788726046.267011:0:8496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788726046.267014:0:8496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788726046 00002000:00010000:0.0:1788726046.267017:0:8496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788726046 00002000:00010000:0.0:1788726046.267019:0:8496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788726046 00010000:00010000:0.0:1788726046.267025:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 9 pid: 9742 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.267060:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 9 pid: 9742 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.267085:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c13e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a003 expref: 9 pid: 9742 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.267103:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788726046.267108:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788726046.267113:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c1433 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.267123:0:8496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c1433 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.267158:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726046.267210:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2352:x1875614914081664:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 237us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726046.267253:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00010000:00010000:3.0:1788726046.268055:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c1433 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.268069:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c1433 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.268099:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c1433 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.268108:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c1433 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.268115:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c1433 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.268138:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031000 already unused, calling callback (ffffffffc142a230) 00010000:00010000:3.0:1788726046.268142:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c1433 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.268151:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c1433 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.268166:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c1433 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.268173:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c1433 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726046.268290:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2351:x1875614914081408:12345-192.168.201.42@tcp:1:lfs.0 Request processed in 54269us (54752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726046.268299:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:1.0:1788726046.273901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726046.273983:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914081920 00000100:00100000:3.0:1788726046.273993:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914081920 00000100:00100000:3.0:1788726046.274052:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:3.0:1788726046.274063:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:10288:x1875614914081920:12345-192.168.201.42@tcp:35:lfs.0 00000004:00010000:3.0:1788726046.274127:0:5838:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1425 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a01f expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788726046.274468:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788726046.274541:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1788726046.275981:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1788726046.276066:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c143a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.276085:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c13ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ff5 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.276094:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c143a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.276133:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c13ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ff5 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.276148:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c13ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ff5 expref: 24 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726046.276164:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5838:1875614935087872:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726046.276298:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1068f8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788726046.280995:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5838:1875614935087872:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788726046.281027:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c143a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726046.281175:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726046.281905:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914082048 00000100:00100000:3.0:1788726046.281915:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914082048 00010000:00010000:3.0:1788726046.281955:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c13ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ff5 expref: 25 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726046.282112:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:3.0:1788726046.282123:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+25:2350:x1875614914082048:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726046.282151:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726046.282159:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c13ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ff5 expref: 25 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.282172:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c13ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ff5 expref: 25 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.282192:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c13ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be90559ff5 expref: 25 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.282211:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe500) 00010000:00010000:3.0:1788726046.282257:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c143a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.282267:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c143a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.282275:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c143a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.282298:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726046.282360:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:2350:x1875614914082048:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 239us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726046.282368:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00010000:00010000:2.0:1788726046.284449:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c143a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.284464:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c143a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788726046.284840:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788726046.285047:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788726046.285187:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875614935088000:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788726046.285290:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726046.285917:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111014000 going to sleep for 11 seconds 00000100:00100000:0.0:1788726046.285974:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935088000 00000100:00100000:0.0:1788726046.285982:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935088000 00000100:00100000:0.0:1788726046.286079:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788726046.286089:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1875614935088000:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788726046.286286:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1875614935088000:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 198us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726046.286293:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788726046.286464:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788726046.287902:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875614935088000:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788726046.289421:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788726046.289522:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ad52300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875614935088128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788726046.289871:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726046.289955:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12ae09000 going to sleep for 11 seconds 00000100:00100000:3.0:1788726046.290011:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935088128 00000100:00100000:3.0:1788726046.290018:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935088128 00000100:00100000:3.0:1788726046.290110:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788726046.290121:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1875614935088128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788726046.290356:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5838:x1875614935088128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 236us (485us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788726046.290373:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788726046.290450:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ad52300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875614935088128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788726046.290517:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788726046.290565:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c143a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.290585:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c143a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.290593:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c143a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.290599:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149ae00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726046.290611:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c143a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.290619:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c143a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.290635:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe500) 00010000:00010000:1.0:1788726046.290639:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788726046.290644:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c143a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.290650:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c143a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788726046.290857:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788726046.291069:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788726046.291081:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341340864187ns, next at 342340862415ns, rc = 0 00000001:00080000:1.0:1788726046.291088:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788726046.291119:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe500) 00010000:00010000:1.0:1788726046.291122:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788726046.291129:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1425 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a01f expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726046.291249:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:10288:x1875614914081920:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 17187us (17356us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788726046.291257:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000020:00080000:1.0:1788726046.291260:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788726046.295949:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726046.296042:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914082176 00000100:00100000:0.0:1788726046.296053:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914082176 00000100:00100000:0.0:1788726046.296156:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:0.0:1788726046.296168:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:10288:x1875614914082176:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726046.296193:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726046.296378:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1441 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a026 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.296439:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1441 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a026 expref: 28 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.296455:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1441 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a026 expref: 28 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.296475:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:0.0:1788726046.296489:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788726046.296493:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100030200, rc 0) 00000100:00100000:0.0:1788726046.296649:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:10288:x1875614914082176:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 482us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726046.296657:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:2.0:1788726046.304434:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726046.304625:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914082432 00000100:00100000:0.0:1788726046.304637:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914082432 00000100:00100000:0.0:1788726046.304781:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:0.0:1788726046.304792:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111087c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:10288:x1875614914082432:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788726046.305086:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111087c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:10288:x1875614914082432:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 295us (877us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788726046.305095:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:2.0:1788726046.421813:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788726046.421850:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a8ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935088256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788726046.421919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726046.421994:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935088256 00000100:00100000:2.0:1788726046.422003:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935088256 00000100:00100000:2.0:1788726046.422049:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788726046.422058:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875614935088256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788726046.422080:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788726046.422127:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875614935088256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726046.422134:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788726046.422179:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a8ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935088256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788726046.433864:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726046.433905:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914082688 00000100:00100000:3.0:1788726046.433917:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914082688 00000100:00100000:3.0:1788726046.433967:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:3.0:1788726046.433977:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:10298:x1875614914082688:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726046.434002:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726046.434021:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c1448 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a02d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726046.434109:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788726046.434355:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c1448 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a02d expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.434370:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639200) 00010000:00010000:3.0:1788726046.434374:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788726046.434379:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c1448 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a02d expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.434392:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10149b200, rc 0) 00000100:00100000:3.0:1788726046.434443:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:10298:x1875614914082688:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 467us (587us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788726046.434451:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:1.0:1788726046.449315:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726046.449672:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914082816 00000100:00100000:3.0:1788726046.449693:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914082816 00000100:00100000:3.0:1788726046.449746:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:3.0:1788726046.449758:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:10298:x1875614914082816:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:3.0:1788726046.449834:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c1456 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.449851:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c1456 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.449862:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c1456 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.449879:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c145d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.449886:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c145d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.449893:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c145d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450253:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1464 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450263:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450270:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788726046.450312:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450324:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c1456 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450340:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c1456 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450347:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c1456 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450353:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149ac00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726046.450358:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c1456 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450365:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c1456 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450378:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726046.450381:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726046.450386:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c1456 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450391:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c1456 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450404:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c145d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450409:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c145d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450414:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c145d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450418:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149ba00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726046.450426:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c145d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450431:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c145d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450439:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a111639700) 00010000:00010000:3.0:1788726046.450441:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726046.450444:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c145d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450450:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c145d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450465:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450470:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1464 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450490:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450495:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149ae00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726046.450498:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450503:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1464 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450510:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:3.0:1788726046.450512:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726046.450522:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1464 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.450528:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1464 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726046.450603:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:10298:x1875614914082816:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 845us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726046.450612:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:2.0:1788726046.457386:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726046.457486:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914083072 00000100:00100000:1.0:1788726046.457505:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914083072 00000100:00100000:1.0:1788726046.457564:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:1.0:1788726046.457575:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:10298:x1875614914083072:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:1.0:1788726046.458001:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+31:10298:x1875614914083072:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 426us (624us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788726046.458011:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000001:00080000:1.0:1788726046.488019:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00000004:00080000:1.0:1788726046.488053:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788726046.488077:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a12ae099c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788726046.488083:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a13ad85c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a12ae09a80 00000020:00080000:1.0:1788726046.488086:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a13ad85700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a103141000 00000100:00100000:1.0:1788726046.488243:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935088384:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1788726046.488390:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1788726046.488462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788726046.488499:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788726046.488551:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935088384 00000100:00100000:2.0:1788726046.488559:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935088384 00000100:00100000:2.0:1788726046.488610:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788726046.488620:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875614935088384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788726046.488646:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788726046.488680:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9dcb1e, atime: 0x6a9dcb1e, ctime: 0x6a9dcb1e, blocks: 0x1 00010000:00010000:2.0:1788726046.488697:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ba8bd1a/0xcbde9110e47c146b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.488710:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1788726046.488713:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726046.488729:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ba8bd1a/0xcbde9110e47c146b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.488740:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ba8bd1a/0xcbde9110e47c146b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.488748:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ba8bd1a/0xcbde9110e47c146b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.488752:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ba8bd1a/0xcbde9110e47c146b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.488768:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788726046.488843:0:8494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726046.488849:0:8494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ba8bd1a/0xcbde9110e47c146b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.488857:0:8494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea000 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726046.488861:0:8494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ba8bd1a/0xcbde9110e47c146b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.488869:0:8494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ba8bd1a/0xcbde9110e47c146b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.488887:0:8494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ba8bd1a/0xcbde9110e47c146b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.488912:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ba8bd1a/0xcbde9110e47c146b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.488930:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726046.488932:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726046.488934:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726046.489196:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1875614935088384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 576us (733us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788726046.489203:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1788726046.489375:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a13b027800/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788726046.489381:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935088384:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788726046.563333:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726046.563404:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914083328 00000100:00100000:1.0:1788726046.563416:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914083328 00000100:00100000:1.0:1788726046.563488:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:1.0:1788726046.563498:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:10301:x1875614914083328:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788726046.563533:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726046.563555:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921c00/0xcbde9110e47c1472 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a034 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.563626:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1479 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.563639:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1479 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.563649:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1479 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.563664:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1480 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.563681:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.563808:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.564128:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1487 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.564138:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.564146:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726046.564154:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788726046.565412:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1479 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.565425:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1479 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.565432:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1479 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.565437:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726046.565442:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1479 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.565450:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1479 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.565488:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:1.0:1788726046.565491:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726046.565497:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1479 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.566434:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1479 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.566458:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.566465:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1480 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.566481:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1480 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.566488:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726046.566492:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1480 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.566499:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1480 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.566766:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a10d14d700) 00010000:00010000:1.0:1788726046.566770:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726046.566774:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1480 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.566780:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1480 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.566866:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921c00/0xcbde9110e47c1472 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a034 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.566882:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1487 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a034 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726046.566889:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:1.0:1788726046.566891:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788726046.566894:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920800, rc 0) 00000100:00100000:1.0:1788726046.567035:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:10301:x1875614914083328:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 3536us (3710us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788726046.567044:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:2.0:1788726046.574998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726046.575147:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914083456 00000100:00100000:3.0:1788726046.575158:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914083456 00000100:00100000:0.0:1788726046.575354:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:0.0:1788726046.575367:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:10301:x1875614914083456:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:0.0:1788726046.575440:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1495 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.575458:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.575470:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.575675:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.575684:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1495 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.575690:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1495 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.575697:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726046.575701:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1495 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.575708:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1495 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.575721:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:0.0:1788726046.575724:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788726046.575729:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1495 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726046.575752:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1495 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726046.575901:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:10301:x1875614914083456:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 535us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726046.575910:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:2.0:1788726046.578672:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726046.578785:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914083712 00000100:00100000:0.0:1788726046.578794:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914083712 00000100:00100000:0.0:1788726046.578850:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:0.0:1788726046.578860:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:10301:x1875614914083712:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788726046.579114:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:10301:x1875614914083712:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 254us (450us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788726046.579123:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00010000:00010000:1.0:1788726046.741463:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726046.924142:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726046.924271:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914083968 00000100:00100000:2.0:1788726046.924282:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914083968 00000100:00100000:2.0:1788726046.924345:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:2.0:1788726046.924355:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:10332:x1875614914083968:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:2.0:1788726046.924379:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726046.924400:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c149c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a03b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.924508:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c14a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.924534:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c14a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.924546:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c14a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726046.924558:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788726046.924705:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c149c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a03b expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.924726:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c14a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a03b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726046.924734:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:2.0:1788726046.924738:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726046.924741:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eba00, rc 0) 00000100:00100000:2.0:1788726046.924805:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:10332:x1875614914083968:12345-192.168.201.42@tcp:101:cat.0 Request processed in 450us (671us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788726046.924812:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:2.0:1788726046.930794:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726046.930878:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726046.931285:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914084352 00000100:00100000:0.0:1788726046.931295:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914084352 00000100:00100000:0.0:1788726046.931360:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:0.0:1788726046.931370:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:10332:x1875614914084352:12345-192.168.201.42@tcp:35:cat.0 00000100:00100000:0.0:1788726046.931639:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:10332:x1875614914084352:12345-192.168.201.42@tcp:35:cat.0 Request processed in 269us (759us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788726046.931647:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:3.0:1788726046.931837:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914084096 00000100:00100000:3.0:1788726046.931843:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914084096 00000100:00100000:3.0:1788726046.932118:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:3.0:1788726046.932128:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:2351:x1875614914084096:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726046.932141:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726046.932165:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c14a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a03b expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726046.932183:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:3.0:1788726046.932188:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726046.932212:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:2351:x1875614914084096:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 86us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726046.932257:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:3.0:1788726047.029342:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726047.029477:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914084608 00000100:00100000:0.0:1788726047.029488:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914084608 00000100:00100000:0.0:1788726047.029576:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:0.0:1788726047.029587:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:10338:x1875614914084608:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:0.0:1788726047.029614:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726047.029631:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788726047.029661:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1402 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a011 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.029795:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726047.029800:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788726047.029815:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c14b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a042 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788726047.030020:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788726047.030115:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.030130:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1487 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a034 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.030139:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.030174:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1487 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a034 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.030186:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1487 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a034 expref: 18 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726047.030199:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a8eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875614935088512:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726047.030338:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a110318c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788726047.045288:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726047.045385:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914084736 00000100:00100000:1.0:1788726047.045395:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914084736 00010000:00010000:1.0:1788726047.045437:0:8495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1487 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a034 expref: 19 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726047.045487:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:1.0:1788726047.045506:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1202a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:2349:x1875614914084736:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726047.045522:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726047.045530:0:8495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1487 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a034 expref: 19 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.045544:0:8495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1487 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a034 expref: 19 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.045574:0:8495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:1.0:1788726047.045577:0:8495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.045584:0:8495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.045589:0:8495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.045602:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726047.045649:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1202a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:2349:x1875614914084736:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 154us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726047.045654:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00010000:00010000:0.0:1788726047.045894:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1487 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a034 expref: 18 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726047.045926:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a8eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875614935088512:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726047.045960:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.045970:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.045976:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726047.045996:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788726047.046183:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c14b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a042 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.046201:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a042 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.046209:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:0.0:1788726047.046211:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788726047.046252:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100031000, rc 0) 00000100:00100000:0.0:1788726047.046287:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:10338:x1875614914084608:12345-192.168.201.42@tcp:101:dd.0 Request processed in 16701us (16955us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788726047.046295:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:2.0:1788726047.051332:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726047.051430:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914084992 00000100:00100000:1.0:1788726047.051441:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914084992 00000100:00100000:1.0:1788726047.051603:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:1.0:1788726047.051614:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:10338:x1875614914084992:12345-192.168.201.42@tcp:36:dd.0 00010000:00010000:1.0:1788726047.055616:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c14c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.055639:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c14c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.055651:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c14c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788726047.058894:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1788726047.060303:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004784648f reply state 00000000c36a3535 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c14c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726047.060332:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788726047.060475:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:10338:x1875614914084992:12345-192.168.201.42@tcp:36:dd.0 Request processed in 8850us (9140us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788726047.060485:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 52 00000020:00080000:1.0:1788726047.060491:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788726047.064121:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c14c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726047.064137:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c14c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726047.064162:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c14c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726047.064168:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726047.064173:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c14c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726047.064181:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c14c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726047.064197:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:2.0:1788726047.064200:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726047.064204:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c14c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726047.064209:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c14c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726047.543209:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726047.543356:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914085120 00000100:00100000:1.0:1788726047.543368:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914085120 00000100:00100000:1.0:1788726047.543430:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:1.0:1788726047.543441:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:10352:x1875614914085120:12345-192.168.201.42@tcp:101:stat.0 00010000:00010000:1.0:1788726047.543479:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726047.543501:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c14cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a049 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.543565:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c14d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.543580:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c14d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.543591:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c14d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.543605:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c14db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.543612:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c14db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.543617:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c14db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.544039:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c14e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.544052:0:7629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a042 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.544061:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c14e2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.544092:0:7629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a042 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.544106:0:7629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a042 expref: 21 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726047.544120:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ad50380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935088640:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788726047.544248:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12ae09840 going to sleep for 11 seconds 00000100:00100000:1.0:1788726047.556259:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726047.556919:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914085376 00000100:00100000:2.0:1788726047.556941:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914085376 00000100:00100000:2.0:1788726047.557000:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:2.0:1788726047.557011:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:5591:x1875614914085376:12345-192.168.201.42@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788726047.557386:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:5591:x1875614914085376:12345-192.168.201.42@tcp:35:ldlm_bl.0 Request processed in 376us (1136us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788726047.557395:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:3.0:1788726047.560364:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726047.560595:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914085504 00000100:00100000:2.0:1788726047.560606:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914085504 00010000:00010000:2.0:1788726047.560650:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a042 expref: 23 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726047.560718:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:2.0:1788726047.560798:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:2349:x1875614914085504:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726047.560813:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726047.560820:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a042 expref: 23 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726047.560835:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a042 expref: 23 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726047.560857:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:2.0:1788726047.560862:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c14e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726047.560872:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c14e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726047.561058:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c14e2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726047.561082:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726047.561142:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:2349:x1875614914085504:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 347us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726047.561149:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00010000:00010000:0.0:1788726047.563485:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a042 expref: 22 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726047.563512:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ad50380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935088640:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726047.563550:0:7629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c14e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.563561:0:7629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c14e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.563567:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c14e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726047.563614:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788726047.563619:0:7629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788726047.566992:0:7629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c14e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567017:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c14e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567028:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c14d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567035:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c14d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567043:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c14d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567049:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726047.567053:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c14d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567061:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c14d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567113:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726047.567116:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726047.567122:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c14d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567128:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c14d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567148:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c14db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567155:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c14db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567160:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c14db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567166:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726047.567169:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c14db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567175:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c14db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567182:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a10d14d700) 00010000:00010000:0.0:1788726047.567185:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726047.567188:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c14db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567193:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c14db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567268:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c14cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a049 expref: 22 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567284:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c14e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a049 expref: 21 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.567293:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:0.0:1788726047.567294:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788726047.567297:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920600, rc 0) 00000100:00100000:0.0:1788726047.567374:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:10352:x1875614914085120:12345-192.168.201.42@tcp:101:stat.0 Request processed in 23934us (24174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726047.567383:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:3.0:1788726047.664346:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726047.664514:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914085760 00000100:00100000:2.0:1788726047.664525:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914085760 00000100:00100000:2.0:1788726047.664591:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:2.0:1788726047.664602:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:10358:x1875614914085760:12345-192.168.201.42@tcp:36:truncate.0 00010000:00010000:2.0:1788726047.664684:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726047.664713:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c14e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a049 expref: 21 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726047.664733:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:2.0:1788726047.664739:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788726047.664968:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c14e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726047.664983:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c14e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726047.664992:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c14e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788726047.665047:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788726047.665072:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a577c4b reply state 0000000038cded28 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c14e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726047.665081:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788726047.665188:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:10358:x1875614914085760:12345-192.168.201.42@tcp:36:truncate.0 Request processed in 587us (852us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788726047.665195:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 54 00000020:00080000:2.0:1788726047.665200:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788726047.668131:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c14e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.668148:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c14e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.668156:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c14e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.668162:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726047.668166:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c14e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.668173:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c14e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.668189:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:0.0:1788726047.668208:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726047.668266:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c14e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.668274:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c14e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726047.766032:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726047.850357:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726047.850574:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914085888 00000100:00100000:0.0:1788726047.850585:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914085888 00000100:00100000:0.0:1788726047.850821:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:0.0:1788726047.850832:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:10372:x1875614914085888:12345-192.168.201.42@tcp:101:stat.0 00010000:00010000:0.0:1788726047.850869:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726047.850900:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a050 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.850973:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c14f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.850998:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c14f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851009:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c14f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851024:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c14fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851031:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c14fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851037:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c14fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851547:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1505 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851559:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1505 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851566:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1505 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726047.851606:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788726047.851611:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788726047.851632:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1505 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851645:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1505 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851653:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c14f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851659:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c14f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851678:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c14f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851685:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726047.851690:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c14f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851697:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c14f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851786:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726047.851789:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726047.851794:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c14f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851800:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c14f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851814:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c14fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851820:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c14fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851825:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c14fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851830:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726047.851832:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c14fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851837:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c14fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851853:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a12bdfee00) 00010000:00010000:0.0:1788726047.851856:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726047.851859:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c14fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851864:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c14fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851968:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c14f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a050 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851983:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1505 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a050 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726047.851991:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:0.0:1788726047.851993:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788726047.851996:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100030400, rc 0) 00000100:00100000:0.0:1788726047.852111:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:10372:x1875614914085888:12345-192.168.201.42@tcp:101:stat.0 Request processed in 1281us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726047.852117:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:3.0:1788726047.966808:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726047.966939:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914086144 00000100:00100000:1.0:1788726047.966950:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914086144 00000100:00100000:1.0:1788726047.967061:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:1.0:1788726047.967072:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:10382:x1875614914086144:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788726047.967094:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726047.967115:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c150c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a057 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726047.967207:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788726047.967401:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c150c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a057 expref: 25 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.967416:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639200) 00010000:00010000:1.0:1788726047.967419:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788726047.967424:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c150c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a057 expref: 25 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726047.967440:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921400, rc 0) 00000100:00100000:1.0:1788726047.967515:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:10382:x1875614914086144:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 444us (717us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788726047.967523:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:2.0:1788726047.971317:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726047.972172:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914086400 00000100:00100000:0.0:1788726047.972185:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914086400 00000100:00100000:0.0:1788726047.972276:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:0.0:1788726047.972287:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:10382:x1875614914086400:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788726047.972668:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+25:10382:x1875614914086400:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 374us (1362us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788726047.972677:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:3.0:1788726048.037475:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726048.037610:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914086656 00000100:00100000:1.0:1788726048.037622:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914086656 00000100:00100000:1.0:1788726048.037794:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:1.0:1788726048.037805:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+25:10388:x1875614914086656:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788726048.037831:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726048.037851:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c151a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a05e expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.037954:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.037970:0:7629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1505 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a050 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.037978:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.038030:0:7629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1505 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a050 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.038043:0:7629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1505 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a050 expref: 26 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726048.038058:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ad51880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935088768:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788726048.038155:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12ae09f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788726048.040962:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ad51880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935088768:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788726048.040989:0:7629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726048.043261:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726048.044109:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914086784 00000100:00100000:0.0:1788726048.044122:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914086784 00010000:00010000:0.0:1788726048.044177:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1505 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a050 expref: 27 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726048.044315:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:0.0:1788726048.044326:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:2349:x1875614914086784:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726048.044354:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726048.044362:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1505 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a050 expref: 27 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.044375:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1505 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a050 expref: 27 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.044398:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1505 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a050 expref: 27 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.044415:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:0.0:1788726048.044420:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.044430:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.044436:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.044478:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726048.044534:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:2349:x1875614914086784:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 209us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726048.044541:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00010000:00010000:2.0:1788726048.045493:0:7629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.045505:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726048.045537:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788726048.045688:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c151a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a05e expref: 27 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.045714:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a05e expref: 26 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.045723:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:2.0:1788726048.045726:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788726048.045728:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921000, rc 0) 00000100:00100000:2.0:1788726048.045775:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:10388:x1875614914086656:12345-192.168.201.42@tcp:101:bash.0 Request processed in 7973us (8309us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788726048.045783:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:3.0:1788726048.049461:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726048.049679:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914087040 00000100:00100000:2.0:1788726048.049690:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914087040 00000100:00100000:2.0:1788726048.049758:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:2.0:1788726048.049769:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:10388:x1875614914087040:12345-192.168.201.42@tcp:36:bash.0 00010000:00010000:2.0:1788726048.050033:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c152f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.050051:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c152f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.050062:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c152f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788726048.050137:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788726048.050169:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085a5b40a reply state 000000005166a8f9 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c152f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726048.050179:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788726048.050442:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:10388:x1875614914087040:12345-192.168.201.42@tcp:36:bash.0 Request processed in 674us (1000us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788726048.050459:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 58 00000020:00080000:2.0:1788726048.050464:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788726048.059185:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:1.0:1788726048.059301:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c152f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.059315:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c152f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.059323:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c152f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.059329:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726048.059334:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c152f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.059342:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c152f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.059360:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:1.0:1788726048.059381:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726048.059387:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c152f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.059393:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c152f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726048.060488:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914087168 00000100:00100000:0.0:1788726048.060502:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914087168 00000100:00100000:1.0:1788726048.060678:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:1.0:1788726048.060690:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:10388:x1875614914087168:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788726048.060825:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726048.060846:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1536 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a065 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.060928:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c153d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.060942:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a05e expref: 29 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.060951:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c153d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.060984:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a05e expref: 29 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.060998:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a05e expref: 29 pid: 7629 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726048.061011:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ad51880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875614935088896:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788726048.061116:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12ae09f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788726048.064442:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ad51880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875614935088896:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788726048.064478:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c153d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726048.065384:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726048.065470:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914087296 00000100:00100000:3.0:1788726048.065478:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914087296 00010000:00010000:3.0:1788726048.065520:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a05e expref: 30 pid: 7629 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726048.065562:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:3.0:1788726048.065572:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:2349:x1875614914087296:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726048.065586:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726048.065593:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a05e expref: 30 pid: 7629 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.065606:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a05e expref: 30 pid: 7629 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.065626:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1521 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a05e expref: 30 pid: 7629 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.065643:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:3.0:1788726048.065648:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c153d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.065675:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c153d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.065681:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c153d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.065716:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726048.065769:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:2349:x1875614914087296:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 198us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726048.065777:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00010000:00010000:1.0:1788726048.066492:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c153d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.066502:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c153d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726048.066547:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788726048.066552:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788726048.066576:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c153d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.066607:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1536 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a065 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.066623:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c153d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a065 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.066630:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:1.0:1788726048.066633:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788726048.066636:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921800, rc 0) 00000100:00100000:1.0:1788726048.066683:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:10388:x1875614914087168:12345-192.168.201.42@tcp:101:bash.0 Request processed in 5995us (7511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726048.066691:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:2.0:1788726048.070957:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726048.071090:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914087552 00000100:00100000:1.0:1788726048.071112:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914087552 00000100:00100000:1.0:1788726048.071172:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:1.0:1788726048.071183:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111087050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:10388:x1875614914087552:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:1.0:1788726048.071426:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111087050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:10388:x1875614914087552:12345-192.168.201.42@tcp:35:bash.0 Request processed in 243us (477us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788726048.071434:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:0.0:1788726048.165042:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726048.165149:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914087808 00000100:00100000:2.0:1788726048.165160:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914087808 00000100:00100000:2.0:1788726048.165256:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:2.0:1788726048.165267:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:10398:x1875614914087808:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726048.165292:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726048.165313:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1544 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a06c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726048.165400:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788726048.165522:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1544 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a06c expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.165537:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639200) 00010000:00010000:2.0:1788726048.165540:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788726048.165545:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1544 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a06c expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.165562:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea600, rc 0) 00000100:00100000:2.0:1788726048.165624:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:10398:x1875614914087808:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 359us (591us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788726048.165643:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:1.0:1788726048.170549:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726048.170666:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914087936 00000100:00100000:2.0:1788726048.170677:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914087936 00000100:00100000:2.0:1788726048.170751:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:2.0:1788726048.170762:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:10398:x1875614914087936:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:2.0:1788726048.170844:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1552 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.170861:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1552 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.170873:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1552 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.170888:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1559 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.170895:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.170901:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171197:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1560 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171208:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171238:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788726048.171290:0:7629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171305:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1552 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171311:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1552 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171318:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1552 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171324:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726048.171328:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1552 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171335:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1552 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171348:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:2.0:1788726048.171351:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726048.171355:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1552 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171361:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1552 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171373:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171378:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1559 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171389:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1559 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171394:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eac00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726048.171397:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1559 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171403:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1559 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171409:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a11214c000) 00010000:00010000:2.0:1788726048.171412:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726048.171415:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1559 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171419:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1559 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171433:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171440:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1560 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171456:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171462:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eaa00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726048.171464:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171481:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1560 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171489:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:2.0:1788726048.171491:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726048.171494:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1560 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.171499:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1560 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726048.171589:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:10398:x1875614914087936:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 826us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726048.171597:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:3.0:1788726048.179799:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726048.179899:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914088192 00000100:00100000:0.0:1788726048.179910:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914088192 00000100:00100000:0.0:1788726048.179983:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:0.0:1788726048.179994:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:10398:x1875614914088192:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788726048.180276:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+31:10398:x1875614914088192:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 283us (487us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788726048.180284:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:0.0:1788726048.244744:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726048.245128:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914088448 00000100:00100000:2.0:1788726048.245141:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914088448 00000100:00100000:2.0:1788726048.245207:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:2.0:1788726048.245255:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+31:10401:x1875614914088448:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726048.245285:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726048.245319:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1567 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a073 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.245425:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c156e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.245440:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c156e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.245462:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c156e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.245483:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1575 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.245491:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.245497:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246086:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c157c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246096:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c157c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246104:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c157c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726048.246113:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788726048.246200:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c156e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246208:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c156e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246237:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c156e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246244:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eac00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726048.246249:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c156e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246267:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c156e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246279:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:2.0:1788726048.246282:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726048.246286:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c156e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246292:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c156e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246304:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246310:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1575 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246316:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246321:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726048.246324:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246330:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1575 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246337:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a11214c000) 00010000:00010000:2.0:1788726048.246339:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726048.246341:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1575 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246356:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1575 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246405:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1567 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a073 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246417:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c157c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a073 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.246423:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:2.0:1788726048.246425:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726048.246427:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea600, rc 0) 00000100:00100000:2.0:1788726048.246651:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+33:10401:x1875614914088448:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1433us (1918us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788726048.246669:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:3.0:1788726048.254281:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726048.254529:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726048.254619:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914088576 00000100:00100000:2.0:1788726048.254630:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914088576 00000100:00100000:2.0:1788726048.254900:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:2.0:1788726048.254913:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+33:10401:x1875614914088576:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:2.0:1788726048.254980:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c158a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.254996:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c158a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.255007:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c158a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.255050:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c158a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.255057:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c158a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.255063:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c158a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.255069:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ebe00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726048.255073:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c158a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.255081:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c158a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.255093:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:2.0:1788726048.255096:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788726048.255100:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c158a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.255106:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c158a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726048.255248:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+33:10401:x1875614914088576:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 337us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726048.255256:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:0.0:1788726048.255378:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914088704 00000100:00100000:0.0:1788726048.255384:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914088704 00000100:00100000:0.0:1788726048.255429:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:0.0:1788726048.255437:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+33:2350:x1875614914088704:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726048.255464:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726048.255481:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c157c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a073 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.255494:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:0.0:1788726048.255497:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726048.255518:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+32:2350:x1875614914088704:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 82us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726048.255524:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:1.0:1788726048.262964:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726048.263053:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914088960 00000100:00100000:0.0:1788726048.263065:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914088960 00000100:00100000:0.0:1788726048.263126:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:0.0:1788726048.263137:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+32:10401:x1875614914088960:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788726048.263401:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+33:10401:x1875614914088960:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 264us (445us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788726048.263409:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:1.0:1788726048.433882:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726048.434115:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914089216 00000100:00100000:3.0:1788726048.434126:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914089216 00000100:00100000:3.0:1788726048.434193:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:3.0:1788726048.434204:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+33:10419:x1875614914089216:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:3.0:1788726048.434282:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726048.434306:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c1591 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a07a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.434415:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1598 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.434431:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1598 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.434454:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1598 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726048.434480:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788726048.434616:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c1591 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a07a expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.434637:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1598 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a07a expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.434647:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:3.0:1788726048.434650:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788726048.434654:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10149ae00, rc 0) 00000100:00100000:3.0:1788726048.434722:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:10419:x1875614914089216:12345-192.168.201.42@tcp:101:cat.0 Request processed in 519us (849us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788726048.434731:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:3.0:1788726048.468274:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726048.468369:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914089344 00000100:00100000:2.0:1788726048.468378:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914089344 00000100:00100000:2.0:1788726048.468431:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:2.0:1788726048.468465:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:10420:x1875614914089344:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726048.468491:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726048.468512:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c15a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a081 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.468570:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c15ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.468581:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c15ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.468591:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c15ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726048.468622:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788726048.468625:0:7629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726048.468639:0:7629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c15ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.468669:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c15a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a081 expref: 37 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.468685:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c15ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a081 expref: 36 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.468691:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:2.0:1788726048.468693:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788726048.468696:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eaa00, rc 0) 00000100:00100000:2.0:1788726048.468759:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+36:10420:x1875614914089344:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 296us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726048.468775:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:1.0:1788726048.479739:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726048.479955:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914089728 00000100:00100000:0.0:1788726048.479966:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914089728 00000100:00100000:0.0:1788726048.480057:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:0.0:1788726048.480068:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+36:10420:x1875614914089728:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788726048.480472:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+37:10420:x1875614914089728:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 404us (745us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788726048.480480:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:1.0:1788726048.482858:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726048.483561:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914089856 00000100:00100000:0.0:1788726048.483572:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914089856 00000100:00100000:0.0:1788726048.483779:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:0.0:1788726048.483792:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+37:10420:x1875614914089856:12345-192.168.201.42@tcp:103:lfs.0 00010000:00010000:0.0:1788726048.483808:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788726048.483833:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c153d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a065 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.483856:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c1598 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a07a expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.483869:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1441 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a026 expref: 35 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.483881:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe400) 00010000:00010000:0.0:1788726048.483894:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726048.483958:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+34:10420:x1875614914089856:12345-192.168.201.42@tcp:103:lfs.0 Request processed in 168us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726048.483965:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:3.0:1788726048.487556:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726048.490332:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914089984 00000100:00100000:1.0:1788726048.490348:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914089984 00000100:00100000:1.0:1788726048.490425:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:1.0:1788726048.490436:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+34:10420:x1875614914089984:12345-192.168.201.42@tcp:58:lfs.0 00010000:00010000:1.0:1788726048.490564:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c15b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.490577:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c15b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.490586:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c15b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788726048.491118:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788726048.491330:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788726048.491398:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788726048.491535:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+34:10420:x1875614914089984:12345-192.168.201.42@tcp:58:lfs.0 Request processed in 1097us (3985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726048.491553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:1.0:1788726048.511391:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726048.511505:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914090112 00000100:00100000:3.0:1788726048.511516:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914090112 00000100:00100000:3.0:1788726048.511564:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:3.0:1788726048.511573:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+34:10422:x1875614914090112:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726048.511593:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726048.511612:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c15bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a088 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.511683:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c15c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.511696:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c15c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.511947:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c15c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512018:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c15c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512026:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c15c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512033:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c15c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512286:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c15d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512296:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c15d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512365:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c15d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726048.512400:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788726048.512404:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788726048.512421:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c15d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512432:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c15d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512450:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c15c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512466:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c15c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512473:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c15c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512478:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149ac00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726048.512483:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c15c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512491:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c15c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512502:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726048.512505:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726048.512509:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c15c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512516:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c15c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512528:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c15c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512534:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c15c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512540:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c15c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512544:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149a800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726048.512551:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c15c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512557:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c15c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512564:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a111639700) 00010000:00010000:3.0:1788726048.512566:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726048.512568:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c15c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512573:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c15c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512603:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c15bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a088 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512616:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c15d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a088 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.512622:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a10d14d000) 00010000:00010000:3.0:1788726048.512624:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788726048.512626:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10149b200, rc 0) 00000100:00100000:3.0:1788726048.512937:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:10422:x1875614914090112:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1363us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726048.512945:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 67 00000040:00080000:2.0:1788726048.597567:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788726048.597577:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788726048.597626:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788726048.597633:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788726048.598396:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b024e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875614935089024:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788726048.598596:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a11163b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726048.605915:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726048.607069:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914090240 00000100:00100000:3.0:1788726048.607082:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914090240 00000100:00100000:3.0:1788726048.607142:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:3.0:1788726048.607150:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+36:10433:x1875614914090240:12345-192.168.201.42@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788726048.607280:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+36:10433:x1875614914090240:12345-192.168.201.42@tcp:900:lhsmtool_posix.0 Request processed in 130us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726048.607286:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:2.0:1788726048.608995:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b024e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875614935089024:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788726048.614831:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726048.615147:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914090368 00000100:00100000:1.0:1788726048.615158:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914090368 00000100:00100000:1.0:1788726048.615293:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:1.0:1788726048.615318:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:10433:x1875614914090368:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788726048.615355:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788726048.615500:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:10433:x1875614914090368:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 197us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726048.615508:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:3.0:1788726048.618469:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726048.618878:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914090496 00000100:00100000:0.0:1788726048.618889:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914090496 00000100:00100000:0.0:1788726048.618947:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:0.0:1788726048.618958:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:10433:x1875614914090496:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788726048.619094:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c15d7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619111:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c15d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619123:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c15d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619193:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c15de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619202:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c15de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619209:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c15de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619274:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c15e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619282:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c15e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619288:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c15e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726048.619327:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788726048.619346:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788726048.619363:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c15e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619375:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c15d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619381:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c15d7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619386:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c15d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619391:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726048.619395:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c15d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619401:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c15d7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619411:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:0.0:1788726048.619414:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726048.619419:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c15d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619424:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c15d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619447:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c15de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619453:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c15de lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619469:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c15de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619474:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726048.619476:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c15de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619482:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c15de lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619490:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff91a12bdfe400) 00010000:00010000:0.0:1788726048.619493:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726048.619496:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c15de lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619501:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c15de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619516:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c15e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619522:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c15e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619528:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c15e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619532:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726048.619535:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c15e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619551:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c15e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619559:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a10d14d000) 00010000:00010000:0.0:1788726048.619561:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726048.619564:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c15e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.619569:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c15e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726048.619645:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:10433:x1875614914090496:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 689us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726048.619654:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:0.0:1788726048.630901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726048.631246:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914090752 00000100:00100000:1.0:1788726048.631257:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914090752 00000100:00100000:1.0:1788726048.631317:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:1.0:1788726048.631328:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:10433:x1875614914090752:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788726048.631350:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726048.631372:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c15ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a08f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.631496:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c15f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.631512:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c15f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.631523:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c15f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726048.631548:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788726048.631657:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c15f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.631666:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c15f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.631672:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c15f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.631678:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726048.631682:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c15f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.631688:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c15f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.631709:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a10d14d000) 00010000:00010000:1.0:1788726048.631713:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788726048.631718:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c15f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.631725:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c15f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.631770:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c15ec lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a08f expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.631781:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:1.0:1788726048.631784:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788726048.631795:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c15ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a08f expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726048.631805:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920e00, rc 0) 00000100:00100000:1.0:1788726048.631871:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+36:10433:x1875614914090752:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 543us (978us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788726048.631878:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:1.0:1788726048.644730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726048.644802:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914090880 00000100:00100000:0.0:1788726048.644813:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914090880 00000100:00100000:0.0:1788726048.644873:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:0.0:1788726048.644884:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+36:10433:x1875614914090880:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788726048.644926:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788726048.645035:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+36:10433:x1875614914090880:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 152us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726048.645043:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:3.0:1788726048.661364:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726048.661449:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914091136 00000100:00100000:2.0:1788726048.661459:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914091136 00000100:00100000:2.0:1788726048.661531:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:2.0:1788726048.661542:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+36:10433:x1875614914091136:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726048.661563:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726048.661567:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788726048.661595:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c15ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a081 expref: 36 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.661614:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:2.0:1788726048.661619:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788726048.661770:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1601 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a096 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788726048.662561:0:7629:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788726048.662844:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c1608 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.662862:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c1608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.662873:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c1608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.662938:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1601 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a096 expref: 38 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.662960:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c1608 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a096 expref: 37 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.662970:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a111639700) 00010000:00010000:3.0:1788726048.662973:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726048.662976:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10149ba00, rc 0) 00000100:00100000:3.0:1788726048.663177:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+37:10433:x1875614914091136:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1635us (1822us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788726048.663188:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:1.0:1788726048.668472:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726048.668726:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914091392 00000100:00100000:0.0:1788726048.668738:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914091392 00000100:00100000:0.0:1788726048.668833:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:0.0:1788726048.668844:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+37:10433:x1875614914091392:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788726048.668916:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726048.668946:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c1608 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a096 expref: 37 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.668968:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a111639700) 00010000:00010000:0.0:1788726048.668980:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788726048.669009:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1616 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669025:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1616 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669035:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1616 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669103:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c161d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x14b1759d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669112:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c161d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x14b1759d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669120:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c161d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x14b1759d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669430:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1616 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669449:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1616 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669455:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1616 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669478:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726048.669484:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1616 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669492:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1616 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669501:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726048.669504:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726048.669508:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1616 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669514:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c1616 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669525:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c161d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x14b1759d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669530:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c161d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x14b1759d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669535:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c161d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x14b1759d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669539:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726048.669542:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c161d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x14b1759d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669547:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c161d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x14b1759d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669564:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x14b1759d (ffff91a12bdfe400) 00010000:00010000:0.0:1788726048.669566:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726048.669568:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c161d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x14b1759d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.669573:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c161d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x14b1759d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726048.669666:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+36:10433:x1875614914091392:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 822us (1205us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788726048.669673:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:2.0:1788726048.671771:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726048.672473:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914091520 00000100:00100000:3.0:1788726048.672494:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914091520 00000100:00100000:3.0:1788726048.672562:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:3.0:1788726048.672575:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+36:10433:x1875614914091520:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726048.672602:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726048.672628:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1624 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a09d expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.672673:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c162b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.672686:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c162b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.672698:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c162b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.672797:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1624 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a09d expref: 38 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.672815:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c162b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a09d expref: 37 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.672822:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a111639c00) 00010000:00010000:3.0:1788726048.672825:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788726048.672828:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10149ac00, rc 0) 00000100:00100000:3.0:1788726048.672898:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+37:10433:x1875614914091520:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 326us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726048.672906:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:3.0:1788726048.676075:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726048.676350:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914091776 00000100:00100000:0.0:1788726048.676361:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914091776 00000100:00100000:0.0:1788726048.676429:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:0.0:1788726048.676450:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+37:10433:x1875614914091776:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788726048.677893:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1632 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.677918:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.677931:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788726048.678292:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788726048.678314:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343728097396ns, next at 344728084483ns, rc = 0 00000004:00010000:0.0:1788726048.678410:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be16c193 reply state 00000000e4b5244f transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726048.678434:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788726048.679114:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+39:10433:x1875614914091776:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 2671us (3043us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788726048.679124:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:2.0:1788726048.690978:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:0.0:1788726048.692601:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.692618:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1632 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.692626:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.692632:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726048.692637:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.692645:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1632 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.692677:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a111639c00) 00010000:00010000:0.0:1788726048.692680:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788726048.692686:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1632 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.692692:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1632 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726048.694368:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914091904 00000100:00100000:3.0:1788726048.694387:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914091904 00000100:00100000:3.0:1788726048.694499:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:3.0:1788726048.694510:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+38:10433:x1875614914091904:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726048.694538:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726048.694559:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1639 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a0a4 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.694626:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1639 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0a4 expref: 39 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.694641:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1639 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0a4 expref: 39 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.695907:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a111639c00) 00010000:00010000:3.0:1788726048.695913:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788726048.695917:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10149a800, rc 0) 00000100:00100000:3.0:1788726048.695991:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+39:10433:x1875614914091904:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1480us (5019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726048.695999:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:0.0:1788726048.700815:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726048.700892:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914092032 00000100:00100000:3.0:1788726048.700907:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914092032 00000100:00100000:3.0:1788726048.700957:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:3.0:1788726048.700965:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875614914092032:12345-192.168.201.42@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788726048.700998:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp t0 exp 0000000000000000 cur 343 last 0 00000020:00000080:3.0:1788726048.701030:0:6683:0:(genops.c:1385:class_connect()) connect: client 7c11f8bd-dcce-4bc6-a067-83d611fb0a24, cookie 0xcbde9110e47c1640 00002000:00100000:3.0:1788726048.701042:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7c11f8bd-dcce-4bc6-a067-83d611fb0a24/ffff91a13b10b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788726048.701077:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:3.0:1788726048.701356:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788726048.701385:0:6683:0:(import.c:65:import_set_state_nolock()) ffff91a13b10a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788726048.701622:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2348:x1875614914092032:12345-192.168.201.42@tcp:8:lhsmtool_posix.0 Request processed in 654us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726048.701630:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:3.0:1788726048.706952:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726048.707179:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914092160 00000100:00100000:2.0:1788726048.707189:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914092160 00000100:00100000:2.0:1788726048.707335:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:2.0:1788726048.707348:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:0:x1875614914092160:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788726048.709831:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788726048.766082:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1788726048.766508:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:0:x1875614914092160:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 59155us (59558us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788726048.766520:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00000001:00100000:1.0:1788726048.767983:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000100:00100000:0.0:1788726048.776612:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726048.780297:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914092416 00000100:00100000:1.0:1788726048.780316:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914092416 00000100:00100000:0.0:1788726048.783993:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:0.0:1788726048.784009:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+39:10433:x1875614914092416:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788726048.784306:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+40:10433:x1875614914092416:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 299us (7702us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788726048.784314:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00010000:00010000:1.0:1788726048.789443:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726048.791134:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726048.791247:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914092672 00000100:00100000:2.0:1788726048.791259:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914092672 00000100:00100000:2.0:1788726048.791335:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:2.0:1788726048.791347:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+40:10433:x1875614914092672:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788726048.791481:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+40:10433:x1875614914092672:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 136us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726048.791488:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:0.0:1788726048.796640:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726048.796796:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914092800 00000100:00100000:3.0:1788726048.796807:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914092800 00000100:00100000:3.0:1788726048.796869:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:3.0:1788726048.796880:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+40:10433:x1875614914092800:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726048.796902:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726048.796922:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c1647 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a0ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.796996:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c164e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.797013:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c164e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.797026:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c164e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726048.797070:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788726048.797092:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c164e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.797137:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ba00/0xcbde9110e47c1647 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ab expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.797157:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c164e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ab expref: 41 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.797166:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a111639c00) 00010000:00010000:3.0:1788726048.797168:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788726048.797172:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10149ae00, rc 0) 00000100:00100000:3.0:1788726048.797289:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+41:10433:x1875614914092800:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 410us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726048.797296:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:1.0:1788726048.814338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726048.814831:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914092928 00000100:00100000:3.0:1788726048.814841:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914092928 00000100:00100000:3.0:1788726048.815017:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:3.0:1788726048.815029:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2349:x1875614914092928:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726048.815047:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726048.815074:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023d435e4/0xcbde9110e47c1655 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a0b2 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726048.815104:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9dcb20, blocks: 0x1 00010000:00010000:3.0:1788726048.815124:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1788726048.815129:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726048.815139:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d435e4/0xcbde9110e47c1655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b2 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.815179:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000023d435e4/0xcbde9110e47c1655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b2 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.815196:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10db70a00, rc 0) 00000100:00100000:3.0:1788726048.815292:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914092928:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 264us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726048.815300:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:1.0:1788726048.833696:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726048.833826:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914093184 00000100:00100000:2.0:1788726048.833837:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914093184 00000100:00100000:2.0:1788726048.833896:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:2.0:1788726048.833907:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+41:10433:x1875614914093184:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788726048.834027:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+41:10433:x1875614914093184:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 121us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726048.834036:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:2.0:1788726048.836946:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726048.837081:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914093312 00000100:00100000:3.0:1788726048.837090:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914093312 00000100:00100000:3.0:1788726048.837152:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:3.0:1788726048.837164:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:10433:x1875614914093312:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726048.837182:0:9742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726048.837200:0:9742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5929775/0xcbde9110e47c165c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a0b9 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.837250:0:9742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000023d435e4/0xcbde9110e47c1655 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b2 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.837259:0:9742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726048.837263:0:9742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726048.837269:0:9742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5929775/0xcbde9110e47c165c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b9 expref: 7 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.837304:0:9742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000023d435e4/0xcbde9110e47c1655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b2 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726048.837330:0:9742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000023d435e4/0xcbde9110e47c1655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b2 expref: 7 pid: 6680 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726048.837345:0:9742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141da4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9742:1875614935089152:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726048.837488:0:9742:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1012edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788726048.839284:0:9742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141da4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9742:1875614935089152:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726048.839331:0:9742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5929775/0xcbde9110e47c165c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b9 expref: 7 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726048.839348:0:9742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915a00, rc 0) 00000100:00100000:0.0:1788726048.839503:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:10433:x1875614914093312:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 2339us (2565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726048.839514:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:1.0:1788726048.856184:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726048.856307:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914093440 00000100:00100000:2.0:1788726048.856317:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914093440 00010000:00010000:2.0:1788726048.856450:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000023d435e4/0xcbde9110e47c1655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b2 expref: 7 pid: 6680 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726048.856497:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:2.0:1788726048.856514:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2350:x1875614914093440:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726048.856529:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726048.856553:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000023d435e4/0xcbde9110e47c1655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b2 expref: 7 pid: 6680 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.856568:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000023d435e4/0xcbde9110e47c1655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b2 expref: 7 pid: 6680 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.856592:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023d435e4/0xcbde9110e47c1655 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b2 expref: 7 pid: 6680 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.856687:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726048.856691:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726048.856700:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5929775/0xcbde9110e47c165c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b9 expref: 6 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.856709:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5929775/0xcbde9110e47c165c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b9 expref: 6 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726048.856752:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c5929775/0xcbde9110e47c165c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b9 expref: 6 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726048.856767:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b025500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1875614935089280:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788726048.856919:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748600 going to sleep for 11 seconds 00000100:00100000:3.0:1788726048.872792:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b025500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1875614935089280:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788726048.872821:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726048.872891:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914093440:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 16377us (16719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726048.872903:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:3.0:1788726048.878609:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726048.882864:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914093568 00000100:00100000:1.0:1788726048.882880:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914093568 00002000:00100000:1.0:1788726048.882937:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91a141da7480 x1875614914093568/t0(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:444/0 lens 504/0 e 0 to 0 dl 1788726059 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788726048.882948:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a141da7480 with x1875614914093568 ext(0->8) 00002000:00010000:1.0:1788726048.882954:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a141da7480 00000100:00100000:1.0:1788726048.882985:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:1.0:1788726048.882995:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914093568:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788726048.887979:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2350:x1875614914093568:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 4972us (9368us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788726048.888013:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00002000:00100000:1.0:1788726048.888029:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91a141da7480 x1875614914093568/t4294967302(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:444/0 lens 504/448 e 0 to 0 dl 1788726059 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788726048.888040:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a141da7480 with x1875614914093568 ext(0->8) 00002000:00010000:1.0:1788726048.888047:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a141da7480 00000100:00100000:2.0:1788726048.896756:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726048.899854:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914093696 00000100:00100000:3.0:1788726048.899869:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914093696 00000100:00100000:3.0:1788726048.899946:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:3.0:1788726048.899958:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+41:10433:x1875614914093696:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788726048.983629:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+41:10433:x1875614914093696:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 83661us (86871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726048.986918:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 80 00000001:00080000:0.0:1788726048.986975:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1788726048.986986:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788726048.987050:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1788726048.988471:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788726048.988485:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788726048.988498:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788726048.988519:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935089408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788726048.988600:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726048.988881:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935089408 00000100:00100000:0.0:1788726048.988891:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935089408 00000100:00100000:0.0:1788726048.988948:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788726048.988958:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935089408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788726048.989140:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788726048.989144:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788726048 00002000:00010000:0.0:1788726048.989146:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788726048.989148:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788726048 -> 1788726048 00002000:00010000:0.0:1788726048.989150:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788726048.989962:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875614935089408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1003us (1358us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788726048.989973:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788726048.989998:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788726048.990284:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a13a8ef100/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788726048.990294:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935089408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788726048.990561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726048.991584:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914093824 00000100:00100000:0.0:1788726048.991595:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914093824 00000100:00100000:0.0:1788726048.992037:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:0.0:1788726048.992053:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2352:x1875614914093824:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788726049.051582:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1788726049.051602:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1788726049.052842:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2352:x1875614914093824:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 60786us (62275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726049.052854:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:0.0:1788726049.058988:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726049.061611:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914094080 00000100:00100000:3.0:1788726049.061625:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914094080 00000100:00100000:3.0:1788726049.061704:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:3.0:1788726049.061715:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:10433:x1875614914094080:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788726049.061772:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726049.061804:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ae00/0xcbde9110e47c164e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ab expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.061840:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a111639c00) 00010000:00010000:3.0:1788726049.061846:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788726049.061882:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1663 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.061895:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1663 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.061904:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1663 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788726049.062660:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b01ea40e reply state 000000008096a05f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1663 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726049.062674:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788726049.063070:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:10433:x1875614914094080:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 1354us (4090us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788726049.063081:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00080000:3.0:1788726049.063114:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788726049.065768:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1663 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.065785:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1663 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.065793:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1663 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.065798:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726049.065803:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1663 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.065819:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1663 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.065836:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a111639c00) 00010000:00010000:3.0:1788726049.065839:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726049.065843:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1663 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.065849:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1663 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726049.067658:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726049.067730:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914094208 00000100:00100000:1.0:1788726049.067741:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914094208 00000100:00100000:1.0:1788726049.067802:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:1.0:1788726049.067811:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914094208:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788726049.068049:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788726049.068053:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788726048 -> 1788726048 00002000:00010000:1.0:1788726049.068056:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788726046 00002000:00010000:1.0:1788726049.068058:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788726048 -> 1788726048 00002000:00010000:1.0:1788726049.068060:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788726049.068125:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2350:x1875614914094208:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 313us (479us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788726049.068133:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:1.0:1788726049.080619:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726049.082962:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914094464 00000100:00100000:0.0:1788726049.082977:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914094464 00000100:00100000:0.0:1788726049.083083:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:0.0:1788726049.083094:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:10433:x1875614914094464:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788726049.083187:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c166a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.083236:0:7629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c162b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a09d expref: 13 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.083247:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c166a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.083284:0:7629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c162b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a09d expref: 13 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.083297:0:7629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c162b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a09d expref: 13 pid: 7629 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726049.083312:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a8efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935089536:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726049.083404:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a110318840 going to sleep for 11 seconds 00000100:00100000:0.0:1788726049.091204:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726049.091475:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914094592 00000100:00100000:1.0:1788726049.091485:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914094592 00010000:00010000:1.0:1788726049.091531:0:8495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c162b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a09d expref: 14 pid: 7629 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726049.091574:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:1.0:1788726049.091593:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1202a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:2349:x1875614914094592:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726049.091607:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726049.091614:0:8495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c162b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a09d expref: 14 pid: 7629 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.091628:0:8495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c162b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a09d expref: 14 pid: 7629 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.091650:0:8495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a111639c00) 00010000:00010000:1.0:1788726049.091655:0:8495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c166a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.091665:0:8495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c166a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.091672:0:8495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c166a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.091688:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726049.091737:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1202a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:2349:x1875614914094592:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 145us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726049.091743:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00010000:00010000:2.0:1788726049.092022:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149ac00/0xcbde9110e47c162b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a09d expref: 13 pid: 7629 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726049.092038:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a8efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935089536:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726049.092063:0:7629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c166a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.092071:0:7629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c166a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.092077:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c166a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.092105:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c166a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.092112:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c166a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.092119:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c166a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.092380:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726049.092385:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c166a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.092393:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c166a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.092404:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a111639c00) 00010000:00010000:2.0:1788726049.092407:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788726049.092420:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c166a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.092426:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c166a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726049.092537:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+12:10433:x1875614914094464:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 9443us (11925us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788726049.092545:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:3.0:1788726049.101859:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726049.101995:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914094720 00000100:00100000:2.0:1788726049.102005:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914094720 00000100:00100000:2.0:1788726049.102069:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:2.0:1788726049.102079:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914094720:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788726049.102124:0:9742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001357178a/0xcbde9110e47c1671 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.102146:0:9742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5929775/0xcbde9110e47c165c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b9 expref: 7 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.102155:0:9742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788726049.102159:0:9742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788726049.102164:0:9742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001357178a/0xcbde9110e47c1671 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.102200:0:9742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c5929775/0xcbde9110e47c165c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b9 expref: 7 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.102234:0:9742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c5929775/0xcbde9110e47c165c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b9 expref: 7 pid: 9742 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726049.102264:0:9742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b026a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9742:1875614935089664:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788726049.102711:0:9742:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748180 going to sleep for 11 seconds 00000100:00100000:0.0:1788726049.107485:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726049.107519:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914094848 00000100:00100000:0.0:1788726049.107527:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914094848 00010000:00010000:0.0:1788726049.107569:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c5929775/0xcbde9110e47c165c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b9 expref: 8 pid: 9742 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726049.107608:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:0.0:1788726049.107618:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2349:x1875614914094848:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726049.107632:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726049.107678:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c5929775/0xcbde9110e47c165c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b9 expref: 8 pid: 9742 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.107693:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c5929775/0xcbde9110e47c165c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b9 expref: 8 pid: 9742 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.107721:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788726049.107725:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788726049.107731:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001357178a/0xcbde9110e47c1671 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.107740:0:8496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001357178a/0xcbde9110e47c1671 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.107761:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726049.107815:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2349:x1875614914094848:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 198us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726049.107822:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 44 00010000:00010000:3.0:1788726049.108013:0:9742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5929775/0xcbde9110e47c165c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0b9 expref: 7 pid: 9742 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726049.108026:0:9742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b026a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9742:1875614935089664:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788726049.108048:0:9742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001357178a/0xcbde9110e47c1671 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.108059:0:9742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001357178a/0xcbde9110e47c1671 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.108066:0:9742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001357178a/0xcbde9110e47c1671 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.108090:0:9742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001357178a/0xcbde9110e47c1671 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.108109:0:9742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001357178a/0xcbde9110e47c1671 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.108117:0:9742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001357178a/0xcbde9110e47c1671 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.108134:0:9742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb800 already unused, calling callback (ffffffffc142a230) 00010000:00010000:3.0:1788726049.108139:0:9742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001357178a/0xcbde9110e47c1671 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.108149:0:9742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001357178a/0xcbde9110e47c1671 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.108161:0:9742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001357178a/0xcbde9110e47c1671 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.108169:0:9742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001357178a/0xcbde9110e47c1671 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726049.108269:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914094720:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 6191us (6420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726049.108277:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:2.0:1788726049.111190:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726049.111414:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914095104 00000100:00100000:3.0:1788726049.111423:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914095104 00000100:00100000:3.0:1788726049.111509:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:3.0:1788726049.111525:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+12:10433:x1875614914095104:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788726049.111601:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1678 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.111616:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1678 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.111627:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1678 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.111857:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c167f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.111867:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1639 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0a4 expref: 13 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.111876:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c167f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.111906:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1639 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0a4 expref: 13 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.111919:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1639 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0a4 expref: 13 pid: 7629 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726049.111932:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141da6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875614935089792:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726049.112004:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1012edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788726049.116635:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726049.117978:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914095232 00000100:00100000:1.0:1788726049.117990:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914095232 00010000:00010000:1.0:1788726049.118032:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1639 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0a4 expref: 14 pid: 7629 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726049.118202:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:1.0:1788726049.118212:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:2350:x1875614914095232:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726049.118249:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726049.118257:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1639 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0a4 expref: 14 pid: 7629 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.118272:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1639 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0a4 expref: 14 pid: 7629 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.118294:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a111639c00) 00010000:00010000:1.0:1788726049.118299:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c167f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.118307:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c167f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.118313:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c167f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.118330:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726049.118380:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:2350:x1875614914095232:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 170us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726049.118387:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00010000:00010000:2.0:1788726049.120805:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a800/0xcbde9110e47c1639 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0a4 expref: 13 pid: 7629 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726049.120827:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141da6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875614935089792:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726049.120853:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c167f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.120862:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c167f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.120867:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c167f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788726049.121072:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788726049.121852:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788726049.121903:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788726049.121988:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b025f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5834:1875614935089920:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788726049.122052:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726049.122150:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726049.125410:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935089920 00000100:00100000:0.0:1788726049.125439:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935089920 00000100:00100000:0.0:1788726049.125547:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788726049.125559:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1875614935089920:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788726049.126825:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1875614935089920:12345-0@lo:1000:mdt00_000.0 Request processed in 1264us (4767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726049.126838:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788726049.126925:0:5834:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788726049.126931:0:5834:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a13a8ef100, transno 4294967303 00000100:00100000:1.0:1788726049.126946:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b025f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5834:1875614935089920:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788726049.127508:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788726049.127598:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5834:1875614935090048:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788726049.127671:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726049.129023:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12ae090c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726049.129101:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935090048 00000100:00100000:2.0:1788726049.129110:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935090048 00000100:00100000:3.0:1788726049.130589:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788726049.130604:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1875614935090048:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788726049.130929:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5834:x1875614935090048:12345-0@lo:1000:mdt00_000.0 Request processed in 327us (3256us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788726049.130937:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788726049.131017:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5834:1875614935090048:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788726049.131062:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c167f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131072:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c167f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131080:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c167f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131085:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726049.131090:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c167f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131097:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c167f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131112:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a111639c00) 00010000:00010000:1.0:1788726049.131115:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788726049.131120:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c167f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131138:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c167f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131177:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c15b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131184:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c15b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131190:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c15b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131212:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726049.131248:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c15b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131255:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c15b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131264:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a10d14d000) 00010000:00010000:1.0:1788726049.131266:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788726049.131269:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c15b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131275:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c15b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131297:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1686 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131310:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c15d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a088 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131319:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1686 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131351:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c15d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a088 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.131365:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c15d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a088 expref: 16 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726049.131392:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141ac6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875614935090176:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788726049.131479:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a110e9e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788726049.134705:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726049.134874:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141ac6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875614935090176:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788726049.134901:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1686 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726049.134958:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914095360 00000100:00100000:3.0:1788726049.134967:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914095360 00010000:00010000:3.0:1788726049.135008:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c15d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a088 expref: 17 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726049.135047:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:3.0:1788726049.135056:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+17:2350:x1875614914095360:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726049.135074:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726049.135081:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c15d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a088 expref: 17 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.135094:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c15d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a088 expref: 17 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.135116:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149b200/0xcbde9110e47c15d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a088 expref: 17 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.135134:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a10d14d000) 00010000:00010000:3.0:1788726049.135139:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1686 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.135148:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1686 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.135155:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1686 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.135194:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788726049.135340:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1686 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.135349:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1686 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.135360:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1686 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.135367:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1686 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.135375:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1686 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.135380:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726049.135385:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1686 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.135393:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1686 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.135402:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a10d14d000) 00010000:00010000:1.0:1788726049.135411:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726049.135415:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1686 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.135422:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1686 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.135444:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1678 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.135450:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1678 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.135456:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1678 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.135461:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726049.135464:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1678 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.135470:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1678 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.135479:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a10d14d000) 00010000:00010000:1.0:1788726049.135481:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788726049.135484:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1678 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.135489:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1678 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788726049.135811:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788726049.135816:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788726049.135850:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788726049.135855:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788726049.136111:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:2350:x1875614914095360:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 1052us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726049.136123:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:1.0:1788726049.137598:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:10433:x1875614914095104:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 26063us (26403us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788726049.137612:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 83 00000020:00080000:1.0:1788726049.137619:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788726049.156995:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726049.157113:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914095616 00000100:00100000:0.0:1788726049.157124:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914095616 00000100:00100000:0.0:1788726049.157172:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:0.0:1788726049.157181:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:10433:x1875614914095616:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788726049.157929:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788726049.158041:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788726049.158088:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c168d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.158105:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c168d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.158117:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c168d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.158125:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c168d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.158131:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c168d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.158136:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c168d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.158156:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788726049.158275:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+17:10433:x1875614914095616:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 1092us (1289us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788726049.158285:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000020:00080000:0.0:1788726049.158291:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788726049.158891:0:8494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726049.158901:0:8494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c168d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.158911:0:8494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030a00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726049.158915:0:8494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c168d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.158924:0:8494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c168d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.158939:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91a12bdfee00) 00010000:00010000:1.0:1788726049.158943:0:8494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788726049.158947:0:8494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c168d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.158953:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c168d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.158973:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726049.158975:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726049.158976:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788726049.379029:0:11995:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788726049.379041:0:11995:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788726049.379079:0:11995:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788726049.379091:0:11995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788726049.527241:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726049.527363:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914095872 00000100:00100000:0.0:1788726049.527375:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914095872 00000100:00100000:0.0:1788726049.527464:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 84 00000100:00100000:0.0:1788726049.527475:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+17:10444:x1875614914095872:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726049.527503:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726049.527526:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1694 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a0c0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.527632:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c169b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.527647:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c169b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.527660:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c169b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726049.527672:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788726049.527803:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c1694 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0c0 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.527821:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c169b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0c0 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.527831:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726049.527834:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788726049.527837:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100031000, rc 0) 00000100:00100000:0.0:1788726049.527908:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:10444:x1875614914095872:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 434us (707us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788726049.527916:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 84 00000100:00100000:3.0:1788726049.535096:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726049.535267:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914096000 00000100:00100000:2.0:1788726049.535286:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914096000 00000100:00100000:2.0:1788726049.535341:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:2.0:1788726049.535352:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:10444:x1875614914096000:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:2.0:1788726049.535438:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c16a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535455:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c16a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535466:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c16a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535482:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c16b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535489:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c16b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535495:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c16b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535739:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c16b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535748:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c16b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535755:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c16b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788726049.535795:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c16b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535817:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c16a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535823:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c16a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535830:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c16a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535836:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eaa00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726049.535841:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c16a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535849:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c16a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535863:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:2.0:1788726049.535865:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726049.535870:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c16a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535876:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c16a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535887:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c16b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535893:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c16b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535899:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c16b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535910:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726049.535914:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c16b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535920:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c16b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535929:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a11214c000) 00010000:00010000:2.0:1788726049.535931:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726049.535934:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c16b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535939:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c16b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535954:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c16b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535973:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c16b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535979:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c16b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535985:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eac00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726049.535988:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c16b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.535994:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c16b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.536014:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a11214cf00) 00010000:00010000:2.0:1788726049.536016:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726049.536019:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c16b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.536025:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c16b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726049.536114:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:10444:x1875614914096000:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 762us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726049.536122:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:3.0:1788726049.601852:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726049.601987:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914096256 00000100:00100000:0.0:1788726049.602009:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914096256 00000100:00100000:0.0:1788726049.602080:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:0.0:1788726049.602090:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:10447:x1875614914096256:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726049.602111:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726049.602131:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c16be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a0c7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.602202:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c16c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.602263:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c16c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.602275:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c16c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.602292:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.602299:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.602306:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.602986:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c16d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.602999:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c16d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603007:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c16d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726049.603094:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788726049.603195:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c16c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603203:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c16c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603210:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c16c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603307:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726049.603312:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c16c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603319:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c16c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603332:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726049.603335:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726049.603339:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c16c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603345:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c16c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603358:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603364:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603380:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603386:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726049.603388:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603395:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603403:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a12bdfe400) 00010000:00010000:0.0:1788726049.603405:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726049.603408:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603498:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603546:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c16be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0c7 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603561:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c16d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0c7 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.603568:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe000) 00010000:00010000:0.0:1788726049.603570:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788726049.603573:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100031c00, rc 0) 00000100:00100000:0.0:1788726049.603799:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:10447:x1875614914096256:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1708us (1955us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788726049.603818:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:2.0:1788726049.607532:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726049.607618:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914096384 00000100:00100000:3.0:1788726049.607628:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914096384 00000100:00100000:3.0:1788726049.607742:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00100000:3.0:1788726049.607752:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:10447:x1875614914096384:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:3.0:1788726049.607823:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c16e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.607839:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c16e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.607851:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c16e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.607878:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c16e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.607884:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c16e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.607891:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c16e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.607896:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726049.607910:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c16e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.607917:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c16e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.607929:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe000) 00010000:00010000:3.0:1788726049.607931:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788726049.607936:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c16e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726049.607943:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c16e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726049.608114:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:10447:x1875614914096384:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 362us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726049.608122:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00100000:3.0:1788726049.618810:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726049.618942:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914096640 00000100:00100000:0.0:1788726049.618953:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914096640 00000100:00100000:0.0:1788726049.619009:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:0.0:1788726049.619030:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111085c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:10447:x1875614914096640:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788726049.619646:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111085c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:10447:x1875614914096640:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 615us (843us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788726049.619656:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:2.0:1788726049.670110:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726049.670206:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914096896 00000100:00100000:0.0:1788726049.670241:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914096896 00000100:00100000:0.0:1788726049.670291:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:0.0:1788726049.670301:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:9974:x1875614914096896:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788726049.670325:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726049.670345:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c16e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a0ce expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.670525:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.670606:0:7629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c16d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0c7 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.670616:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.670649:0:7629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c16d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0c7 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.670662:0:7629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c16d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0c7 expref: 23 pid: 5836 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726049.671689:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a8ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935090304:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726049.671807:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1103183c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726049.677487:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726049.678032:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914097024 00000100:00100000:1.0:1788726049.678044:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914097024 00010000:00010000:1.0:1788726049.678095:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c16d3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0c7 expref: 24 pid: 5836 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726049.678143:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:1.0:1788726049.678154:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b025f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:2349:x1875614914097024:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726049.678172:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726049.678182:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c16d3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0c7 expref: 24 pid: 5836 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.678200:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c16d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0c7 expref: 24 pid: 5836 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.678275:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe000) 00010000:00010000:1.0:1788726049.678282:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.678293:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.678300:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.678322:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726049.678388:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b025f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:2349:x1875614914097024:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 235us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726049.678396:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00010000:00010000:0.0:1788726049.679147:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c16d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0c7 expref: 23 pid: 5836 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726049.679167:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a8ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935090304:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726049.679190:0:7629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.679200:0:7629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.679205:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726049.679532:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788726049.684101:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030400/0xcbde9110e47c16e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ce expref: 24 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.684136:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ce expref: 23 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.684145:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe000) 00010000:00010000:0.0:1788726049.684148:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788726049.684151:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100030a00, rc 0) 00000100:00100000:0.0:1788726049.684266:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:9974:x1875614914096896:12345-192.168.201.42@tcp:101:bash.0 Request processed in 13964us (14162us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788726049.684293:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:2.0:1788726049.687871:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726049.687947:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914097280 00000100:00100000:1.0:1788726049.687958:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914097280 00000100:00100000:1.0:1788726049.688025:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:1.0:1788726049.688035:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:9974:x1875614914097280:12345-192.168.201.42@tcp:36:bash.0 00010000:00010000:1.0:1788726049.688343:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c16fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.688362:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c16fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.688373:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c16fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788726049.688442:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788726049.688469:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b1c3cba reply state 000000002509619c transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c16fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726049.688478:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788726049.688526:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788726049.688614:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:9974:x1875614914097280:12345-192.168.201.42@tcp:36:bash.0 Request processed in 580us (752us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788726049.688622:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 89 00000020:00080000:1.0:1788726049.688626:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788726049.690453:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c16fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.690470:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c16fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.690478:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c16fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.690484:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726049.690489:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c16fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.690497:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c16fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.690514:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe000) 00010000:00010000:0.0:1788726049.690517:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726049.690522:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c16fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.690527:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c16fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726049.691318:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726049.691604:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914097408 00000100:00100000:1.0:1788726049.691614:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914097408 00000100:00100000:1.0:1788726049.691676:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:1.0:1788726049.691686:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:9974:x1875614914097408:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788726049.691721:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726049.691740:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1704 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a0d5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.691816:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1704 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0d5 expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.691829:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1704 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0d5 expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.691846:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe000) 00010000:00010000:1.0:1788726049.691849:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788726049.691852:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921a00, rc 0) 00000100:00100000:1.0:1788726049.691914:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:9974:x1875614914097408:12345-192.168.201.42@tcp:101:bash.0 Request processed in 229us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726049.691921:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:3.0:1788726049.694828:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726049.695064:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914097536 00000100:00100000:0.0:1788726049.695075:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914097536 00000100:00100000:0.0:1788726049.695137:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:0.0:1788726049.695149:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:9974:x1875614914097536:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788726049.695170:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726049.695205:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6138ba1/0xcbde9110e47c170b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a0dc expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726049.695258:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9dcb20, atime: 0x6a9dcb1e, ctime: 0x6a9dcb20, blocks: 0xb 00010000:00010000:0.0:1788726049.695286:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1788726049.695292:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726049.695302:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6138ba1/0xcbde9110e47c170b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0dc expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.695320:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e6138ba1/0xcbde9110e47c170b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0dc expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726049.695334:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a100030400, rc 0) 00000100:00100000:0.0:1788726049.695403:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:9974:x1875614914097536:12345-192.168.201.42@tcp:101:bash.0 Request processed in 257us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726049.696172:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:2.0:1788726049.698650:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726049.698854:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914097664 00000100:00100000:1.0:1788726049.698867:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914097664 00002000:00010000:1.0:1788726049.698919:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788726049.698925:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13b026a00 with x1875614914097664 ext(0->18446744073709551615) 00002000:00010000:1.0:1788726049.698939:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a13b026a00. 00000100:00100000:1.0:1788726049.698971:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:1.0:1788726049.698981:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2351:x1875614914097664:12345-192.168.201.42@tcp:10:bash.0 00002000:00010000:1.0:1788726049.699319:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788726049.699323:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788726048 -> 1788726049 00002000:00010000:1.0:1788726049.699326:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788726046 -> 1788726046 00002000:00010000:1.0:1788726049.699329:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788726048 -> 1788726049 00002000:00010000:1.0:1788726049.699331:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788726049.699397:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2351:x1875614914097664:12345-192.168.201.42@tcp:10:bash.0 Request processed in 416us (766us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788726049.699672:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00002000:00010000:1.0:1788726049.699807:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788726049.699811:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13b026a00 with x1875614914097664 ext(0->18446744073709551615) 00002000:00010000:1.0:1788726049.699818:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a13b026a00. 00000100:00100000:2.0:1788726049.703050:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726049.703186:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914097792 00000100:00100000:3.0:1788726049.703198:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914097792 00000100:00100000:3.0:1788726049.703285:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 285 00000100:00100000:3.0:1788726049.703297:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:2349:x1875614914097792:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726049.703373:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:2349:x1875614914097792:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 78us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726049.703381:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 285 00000100:00100000:3.0:1788726049.714659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726049.714713:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726049.714743:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914097920 00000100:00100000:0.0:1788726049.714753:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914097920 00000100:00100000:0.0:1788726049.714828:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:0.0:1788726049.714840:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2350:x1875614914097920:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:3.0:1788726049.714865:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788726049.714917:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2350:x1875614914097920:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 80us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726049.714925:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:1.0:1788726049.715255:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914098048 00000100:00100000:1.0:1788726049.715261:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914098048 00000100:00100000:1.0:1788726049.715315:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:1.0:1788726049.715323:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914098048:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:3.0:1788726049.715333:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726049.715368:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914098048:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 46us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726049.715375:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:3.0:1788726049.795280:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726049.796062:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914098176 00000100:00100000:1.0:1788726049.796076:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914098176 00000100:00100000:1.0:1788726049.796150:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:1.0:1788726049.796164:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:10461:x1875614914098176:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:1.0:1788726049.796462:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1712 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.796481:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1712 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.796492:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1712 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.796507:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1719 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.796515:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.796535:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.796897:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1720 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797568:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797578:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788726049.797683:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797695:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1712 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797702:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1712 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797709:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1712 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797715:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726049.797719:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1712 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797726:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1712 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797738:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:1.0:1788726049.797750:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726049.797756:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1712 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797761:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1712 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797776:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797781:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1719 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797786:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1719 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797790:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726049.797793:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1719 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797798:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1719 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797805:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a10d14d000) 00010000:00010000:1.0:1788726049.797807:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726049.797809:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1719 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797814:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1719 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797828:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797840:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1720 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797845:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1720 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797850:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726049.797852:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1720 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797857:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1720 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797865:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe000) 00010000:00010000:1.0:1788726049.797866:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726049.797869:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1720 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.797874:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1720 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726049.798767:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:10461:x1875614914098176:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 2598us (3489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726049.798782:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 91 00010000:00010000:1.0:1788726049.814920:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726049.837286:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726049.837763:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914098432 00000100:00100000:1.0:1788726049.837775:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914098432 00000100:00100000:1.0:1788726049.837889:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:1.0:1788726049.837900:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:10464:x1875614914098432:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788726049.837947:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726049.837968:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1727 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a0e3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838057:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c172e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838072:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c172e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838082:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c172e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838097:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1735 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838104:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838111:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838430:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c173c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838440:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c173c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838455:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c173c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726049.838466:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788726049.838566:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c172e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838573:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c172e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838579:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c172e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838585:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726049.838589:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c172e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838595:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c172e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838606:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:1.0:1788726049.838609:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726049.838614:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c172e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838619:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c172e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838631:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838636:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1735 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838641:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1735 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838645:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726049.838654:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1735 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838659:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1735 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838666:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a10d14d000) 00010000:00010000:1.0:1788726049.838668:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726049.838670:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1735 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838674:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c1735 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838712:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1727 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0e3 expref: 30 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838724:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c173c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0e3 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.838730:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe000) 00010000:00010000:1.0:1788726049.838732:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788726049.838734:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921000, rc 0) 00000100:00100000:1.0:1788726049.838794:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:10464:x1875614914098432:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 896us (1520us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788726049.838802:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:3.0:1788726049.842631:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726049.843018:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914098560 00000100:00100000:2.0:1788726049.843029:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914098560 00000100:00100000:2.0:1788726049.843088:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:2.0:1788726049.843100:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:10464:x1875614914098560:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:2.0:1788726049.843170:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c174a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.843186:0:7629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ce expref: 29 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.843243:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c174a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.843293:0:7629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ce expref: 29 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.843308:0:7629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ce expref: 29 pid: 7629 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726049.843323:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935090432:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788726049.843432:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788726049.847664:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935090432:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726049.847688:0:7629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c174a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726049.852525:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726049.852801:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914098816 00000100:00100000:2.0:1788726049.852812:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914098816 00000100:00100000:2.0:1788726049.852872:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:2.0:1788726049.852884:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:5591:x1875614914098816:12345-192.168.201.42@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788726049.853294:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+31:5591:x1875614914098816:12345-192.168.201.42@tcp:35:ldlm_bl.0 Request processed in 412us (779us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788726049.853302:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:0.0:1788726049.872628:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726049.872818:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914098944 00000100:00100000:1.0:1788726049.872828:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914098944 00010000:00010000:1.0:1788726049.872868:0:8495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ce expref: 31 pid: 7629 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726049.873020:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:1.0:1788726049.873030:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+31:2350:x1875614914098944:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726049.873045:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726049.873052:0:8495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ce expref: 31 pid: 7629 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.873066:0:8495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ce expref: 31 pid: 7629 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.873088:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c16ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ce expref: 31 pid: 7629 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.873105:0:8495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe000) 00010000:00010000:1.0:1788726049.873111:0:8495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c174a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.873121:0:8495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c174a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.873129:0:8495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c174a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726049.873160:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726049.873265:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:2350:x1875614914098944:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 235us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726049.873272:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 48 00010000:00010000:2.0:1788726049.873368:0:7629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c174a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.873386:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c174a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.873433:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c174a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.873441:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c174a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.873455:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c174a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.873462:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726049.873466:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c174a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.873473:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c174a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.873482:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe000) 00010000:00010000:2.0:1788726049.873485:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788726049.873488:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c174a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726049.873494:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c174a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726049.873535:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:10464:x1875614914098560:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 30438us (30914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726049.873543:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:0.0:1788726049.877997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726049.880144:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914099200 00000100:00100000:2.0:1788726049.880159:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914099200 00000100:00100000:2.0:1788726049.880253:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:2.0:1788726049.880279:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:10464:x1875614914099200:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:2.0:1788726049.881762:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:10464:x1875614914099200:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 1478us (3767us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788726049.881775:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:0.0:1788726050.002275:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726050.002409:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914099456 00000100:00100000:3.0:1788726050.002429:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914099456 00000100:00100000:3.0:1788726050.002497:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 94 00000100:00100000:3.0:1788726050.002508:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:10475:x1875614914099456:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:3.0:1788726050.002537:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726050.002557:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1751 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a0ea expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.002650:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c1758 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.002668:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c1758 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.002690:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c1758 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.002706:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c175f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.002715:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c175f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.002733:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c175f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.003370:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1766 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.003443:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.003454:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726050.003465:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788726050.003562:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c1758 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.003571:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c1758 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.003579:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c1758 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.003586:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726050.003591:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c1758 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.003598:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c1758 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.003612:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726050.003615:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726050.003628:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c1758 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.003635:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c1758 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.003649:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c175f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.003655:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c175f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.003662:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c175f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.003667:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726050.004033:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c175f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.004044:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c175f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.004053:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a111639600) 00010000:00010000:3.0:1788726050.004055:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726050.004058:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c175f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.004064:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c175f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.004116:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1751 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ea expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.004145:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ea expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.004154:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe000) 00010000:00010000:3.0:1788726050.004157:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726050.004160:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915e00, rc 0) 00000100:00100000:3.0:1788726050.004775:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+32:10475:x1875614914099456:12345-192.168.201.42@tcp:101:cat.0 Request processed in 2264us (2504us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788726050.004786:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 94 00000100:00100000:1.0:1788726050.008507:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935090944:0@lo:400:kworker.0 00000100:00100000:1.0:1788726050.008594:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726050.008660:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788726050.008666:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935090816:0@lo:400:kworker.0 00000100:00100000:1.0:1788726050.008706:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726050.008745:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935090816 00000100:00100000:1.0:1788726050.008753:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935090816 00000100:00100000:1.0:1788726050.008807:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788726050.008817:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1875614935090816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726050.008872:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1875614935090816:12345-0@lo:400:kworker.0 Request processed in 57us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726050.008879:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788726050.008901:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788726050.008932:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935090816:0@lo:400:kworker.0 00000100:00100000:0.0:1788726050.008948:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935090944 00000100:00100000:0.0:1788726050.008955:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935090944 00000100:00100000:2.0:1788726050.008988:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935090560:0@lo:400:kworker.0 00000100:00080000:1.0:1788726050.008997:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726050.009003:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788726050.009012:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935090944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726050.009028:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726050.009049:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935090944:12345-0@lo:400:kworker.0 Request processed in 39us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726050.009056:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788726050.009076:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935091072:0@lo:400:kworker.0 00000100:00100000:2.0:1788726050.009102:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726050.009138:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788726050.009145:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935090688:0@lo:400:kworker.0 00000100:00100000:2.0:1788726050.009166:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726050.009197:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935091200:0@lo:400:kworker.0 00000100:00100000:0.0:1788726050.009238:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935091072 00000100:00100000:2.0:1788726050.009243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726050.009243:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935091072 00000100:00100000:0.0:1788726050.009268:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935090688 00000100:00100000:0.0:1788726050.009272:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935090688 00000100:00100000:0.0:1788726050.009289:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788726050.009295:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935091072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726050.009299:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788726050.009306:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935090688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726050.009332:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935090688:12345-0@lo:400:kworker.0 Request processed in 27us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726050.009332:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935091072:12345-0@lo:400:kworker.0 Request processed in 37us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726050.009338:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788726050.009364:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935090688:0@lo:400:kworker.0 00000100:00100000:2.0:1788726050.009374:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935091072:0@lo:400:kworker.0 00000100:00100000:1.0:1788726050.010817:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935090560 00000100:00100000:1.0:1788726050.010831:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935090560 00000100:00100000:1.0:1788726050.010898:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788726050.010910:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935090560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726050.011000:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935090560:12345-0@lo:400:kworker.0 Request processed in 92us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726050.011008:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:1.0:1788726050.011045:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726050.011088:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935090944:0@lo:400:kworker.0 00000100:00100000:1.0:1788726050.011130:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935090560:0@lo:400:kworker.0 00000100:00100000:1.0:1788726050.011174:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935091200 00000100:00100000:1.0:1788726050.011179:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935091200 00000100:00100000:1.0:1788726050.011276:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788726050.011283:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875614935091200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726050.011324:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875614935091200:12345-0@lo:400:kworker.0 Request processed in 41us (2080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726050.011331:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788726050.011362:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935091200:0@lo:400:kworker.0 00000100:00080000:2.0:1788726050.014599:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788726050.015382:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788726050.021133:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726050.021270:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914099712 00000100:00100000:1.0:1788726050.021280:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914099712 00000100:00100000:1.0:1788726050.021343:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:1.0:1788726050.021354:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+32:10475:x1875614914099712:12345-192.168.201.42@tcp:35:cat.0 00000100:00100000:1.0:1788726050.021607:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+33:10475:x1875614914099712:12345-192.168.201.42@tcp:35:cat.0 Request processed in 254us (483us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788726050.021614:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:1.0:1788726050.057730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726050.058923:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914099968 00000100:00100000:2.0:1788726050.058936:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914099968 00000100:00100000:2.0:1788726050.059072:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 95 00000100:00100000:2.0:1788726050.059096:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+33:10476:x1875614914099968:12345-192.168.201.42@tcp:36:rm.0 00010000:00010000:2.0:1788726050.059156:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788726050.059183:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1766 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ea expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.059270:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c173c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0e3 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.059286:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1704 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0d5 expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.059296:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a12bdfe000) 00010000:00010000:2.0:1788726050.059307:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788726050.059328:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1774 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.059341:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1774 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.059350:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1774 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.059365:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c177b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.059384:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c177b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.059391:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c177b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.059666:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1782 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.059675:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1782 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.059683:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1782 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788726050.060211:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788726050.060251:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345110034741ns, next at 346110032422ns, rc = 0 00010000:00010000:2.0:1788726050.060304:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1789 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060314:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1789 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060322:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1789 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060329:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1789 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060335:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1789 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060341:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1789 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060369:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726050.060388:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1782 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060401:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1782 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060408:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1782 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060427:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726050.060431:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1782 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060438:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1782 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060448:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a11214c000) 00010000:00010000:2.0:1788726050.060452:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788726050.060456:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1782 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060462:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1782 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060478:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1774 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060484:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1774 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.060487:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726050.060492:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1774 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.060496:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1789 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060500:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726050.060506:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb600 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726050.060510:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1774 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.060512:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1789 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060526:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1774 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.060528:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1789 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.060547:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726050.060550:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91a11214c000) 00010000:00010000:2.0:1788726050.060552:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726050.060556:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1774 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.060563:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788726050.060567:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1774 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.060570:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1789 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.060580:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1789 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788726050.060582:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016e4f700 reply state 00000000cb370e82 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c177b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726050.060594:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788726050.060601:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726050.060604:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726050.060606:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726050.060678:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+32:10476:x1875614914099968:12345-192.168.201.42@tcp:36:rm.0 Request processed in 1582us (2955us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788726050.060687:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 95 00010000:00010000:3.0:1788726050.068848:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c177b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.068866:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c177b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.068874:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c177b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.068879:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eba00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726050.068884:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c177b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.068892:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c177b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.068909:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a11214cf00) 00010000:00010000:3.0:1788726050.068912:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726050.068916:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c177b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.068932:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c177b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726050.116317:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726050.116461:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914100224 00000100:00100000:0.0:1788726050.116472:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914100224 00000100:00100000:0.0:1788726050.116536:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00100000:0.0:1788726050.116549:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+31:10482:x1875614914100224:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788726050.116574:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726050.116595:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1790 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a0f1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.116713:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1797 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.116729:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1797 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.116740:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1797 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.116756:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c179e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.116764:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c179e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.116783:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c179e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788726050.117366:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788726050.117542:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c17a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.117553:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c17a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.117561:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c17a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.117594:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1797 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.117601:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1797 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.117607:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1797 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.117612:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726050.117616:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1797 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.117623:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1797 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.117634:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726050.117638:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726050.117650:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1797 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.117656:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030a00/0xcbde9110e47c1797 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788726050.117671:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000096a7a10 reply state 0000000068f0f2b9 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c179e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726050.117680:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788726050.117707:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100030200/0xcbde9110e47c1790 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f1 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.117721:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c17a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f1 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.117728:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a12bdfee00) 00010000:00010000:0.0:1788726050.117730:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788726050.117733:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725000, rc 0) 00000100:00100000:0.0:1788726050.117807:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+34:10482:x1875614914100224:12345-192.168.201.42@tcp:101:bash.0 Request processed in 1260us (1499us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788726050.117816:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 96 00010000:00010000:2.0:1788726050.122600:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c179e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.122619:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c179e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.122627:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c179e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.122632:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726050.122637:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c179e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.122660:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c179e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.122678:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a12bdfe000) 00010000:00010000:2.0:1788726050.122681:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726050.122686:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c179e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.122692:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031c00/0xcbde9110e47c179e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726050.123645:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726050.124153:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914100352 00000100:00100000:3.0:1788726050.124165:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914100352 00000100:00100000:3.0:1788726050.124245:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:3.0:1788726050.124256:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2352:x1875614914100352:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788726050.124274:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726050.124295:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078fa2b0f/0xcbde9110e47c17b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a0f8 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726050.124321:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726050.124338:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788726050.124342:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726050.124351:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078fa2b0f/0xcbde9110e47c17b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f8 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.124367:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000078fa2b0f/0xcbde9110e47c17b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f8 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.124380:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914400, rc 0) 00000100:00100000:3.0:1788726050.124456:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2352:x1875614914100352:12345-192.168.201.42@tcp:101:bash.0 Request processed in 201us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726050.124464:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:0.0:1788726050.127512:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726050.127598:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914100480 00000100:00100000:1.0:1788726050.127611:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914100480 00000100:00100000:1.0:1788726050.127722:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:1.0:1788726050.127732:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:10482:x1875614914100480:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788726050.127752:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726050.127774:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a0ff expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.127805:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078fa2b0f/0xcbde9110e47c17b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f8 expref: 9 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.127833:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726050.127837:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726050.127843:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.127879:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078fa2b0f/0xcbde9110e47c17b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f8 expref: 9 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.127893:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078fa2b0f/0xcbde9110e47c17b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f8 expref: 9 pid: 6680 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726050.127908:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ad51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1875614935091328:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788726050.128003:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1068f8540 going to sleep for 11 seconds 00000100:00100000:2.0:1788726050.134694:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726050.134789:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914100608 00000100:00100000:0.0:1788726050.134801:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914100608 00010000:00010000:0.0:1788726050.134843:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078fa2b0f/0xcbde9110e47c17b3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f8 expref: 10 pid: 6680 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726050.134888:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:0.0:1788726050.134915:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:2350:x1875614914100608:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726050.134930:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726050.134953:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078fa2b0f/0xcbde9110e47c17b3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f8 expref: 10 pid: 6680 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.134967:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078fa2b0f/0xcbde9110e47c17b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f8 expref: 10 pid: 6680 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.134994:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726050.135000:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726050.135009:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.135019:0:8496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.135059:0:8496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726050.135074:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a447b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8496:1875614935091456:192.168.201.42@tcp:105: 00000100:00100000:0.0:1788726050.135168:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1103183c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788726050.135767:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078fa2b0f/0xcbde9110e47c17b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f8 expref: 10 pid: 6680 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726050.135785:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ad51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1875614935091328:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788726050.135812:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.135825:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921600, rc 0) 00000100:00100000:1.0:1788726050.135910:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:10482:x1875614914100480:12345-192.168.201.42@tcp:101:bash.0 Request processed in 8179us (8410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726050.135930:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:3.0:1788726050.155666:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a447b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8496:1875614935091456:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788726050.155712:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726050.162818:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2350:x1875614914100608:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 27890us (28120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726050.162835:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:0.0:1788726050.163166:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726050.164021:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914100864 00000100:00100000:3.0:1788726050.164033:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914100864 00000100:00100000:3.0:1788726050.164137:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:3.0:1788726050.164148:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+33:10482:x1875614914100864:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:3.0:1788726050.165053:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+34:10482:x1875614914100864:12345-192.168.201.42@tcp:35:bash.0 Request processed in 900us (1881us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788726050.165063:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:0.0:1788726050.384074:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726050.384262:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914100992 00000100:00100000:1.0:1788726050.384275:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914100992 00000100:00100000:1.0:1788726050.384341:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00100000:1.0:1788726050.384352:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+34:10498:x1875614914100992:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788726050.384380:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726050.384402:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c17c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a106 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.384482:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c17c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.384498:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c17c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.384508:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c17c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726050.384545:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788726050.384549:0:7629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788726050.384568:0:7629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c17c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.384593:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c17c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a106 expref: 36 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.384613:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c17c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a106 expref: 35 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.384642:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:1.0:1788726050.384645:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788726050.384649:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920200, rc 0) 00000100:00100000:1.0:1788726050.384721:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:10498:x1875614914100992:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 370us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726050.384728:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00100000:3.0:1788726050.394406:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726050.398609:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914101248 00000100:00100000:0.0:1788726050.398751:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914101248 00000100:00100000:0.0:1788726050.398969:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:0.0:1788726050.399014:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:10498:x1875614914101248:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726050.399048:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726050.399077:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725400/0xcbde9110e47c17cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a10d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.400247:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c17d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.400272:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c17d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.400288:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c17d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726050.400304:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788726050.400753:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725400/0xcbde9110e47c17cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a10d expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.400784:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c17d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a10d expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.400794:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a12bdfee00) 00010000:00010000:0.0:1788726050.400797:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788726050.400801:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724400, rc 0) 00000100:00100000:0.0:1788726050.400984:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+37:10498:x1875614914101248:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1974us (6595us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788726050.401004:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:0.0:1788726050.411021:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726050.411129:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726050.411383:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914101632 00000100:00100000:2.0:1788726050.411395:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914101632 00000100:00100000:1.0:1788726050.411458:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914101376 00000100:00100000:1.0:1788726050.411464:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914101376 00000100:00100000:2.0:1788726050.411527:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 99 00000100:00100000:2.0:1788726050.411543:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+38:10498:x1875614914101632:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726050.411577:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726050.411603:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c17e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a114 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726050.411731:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00010000:00010000:2.0:1788726050.411734:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c17eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726050.411745:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1202a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+39:2350:x1875614914101376:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726050.411754:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c17eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.411759:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726050.411772:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c17eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.411787:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c17d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a10d expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726050.411788:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788726050.411810:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a12bdfee00) 00010000:00010000:1.0:1788726050.411818:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726050.411894:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1202a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+39:2350:x1875614914101376:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 153us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726050.411904:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00010000:00010000:2.0:1788726050.411964:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c17e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a114 expref: 39 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.411981:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c17eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a114 expref: 38 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.411989:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a12bdfee00) 00010000:00010000:2.0:1788726050.411992:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788726050.411995:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eac00, rc 0) 00000100:00100000:2.0:1788726050.412025:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+38:10498:x1875614914101632:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 485us (896us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788726050.412043:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 99 00000100:00100000:2.0:1788726050.416929:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726050.417021:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914101760 00000100:00100000:1.0:1788726050.417043:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914101760 00000100:00100000:1.0:1788726050.417126:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:1.0:1788726050.417138:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2349:x1875614914101760:12345-192.168.201.42@tcp:1:lfs.0 00010000:00010000:1.0:1788726050.417202:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd19a341/0xcbde9110e47c17f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.417304:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.417314:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726050.417319:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788726050.417325:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd19a341/0xcbde9110e47c17f9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.417374:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.417391:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 8 pid: 6682 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726050.417419:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ad51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1875614935091584:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788726050.417534:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1068f8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788726050.428326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726050.428574:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ad51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1875614935091584:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788726050.428613:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bd19a341/0xcbde9110e47c17f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726050.428722:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914101888 00000100:00100000:0.0:1788726050.428732:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914101888 00002000:00100000:0.0:1788726050.428793:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff91a141da4e00 x1875614914101888/t0(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:446/0 lens 504/0 e 0 to 0 dl 1788726061 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788726050.428802:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a141da4e00 with x1875614914101888 ext(0->8) 00010000:00010000:0.0:1788726050.428811:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 9 pid: 6682 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.428827:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 9 pid: 6682 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726050.428835:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91a141da4e00 00000100:00100000:0.0:1788726050.428876:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:0.0:1788726050.428888:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2349:x1875614914101888:12345-192.168.201.42@tcp:4:lfs.0 00000100:00100000:0.0:1788726050.429737:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:2349:x1875614914101888:12345-192.168.201.42@tcp:4:lfs.0 Request processed in 844us (1421us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788726050.429749:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00002000:00100000:0.0:1788726050.429760:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff91a141da4e00 x1875614914101888/t4294967302(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:446/0 lens 504/448 e 0 to 0 dl 1788726061 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788726050.429769:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a141da4e00 with x1875614914101888 ext(0->8) 00010000:00010000:0.0:1788726050.429775:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 11 pid: 6682 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.429791:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 11 pid: 6682 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726050.429812:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91a141da4e00 00000100:00100000:0.0:1788726050.436551:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726050.437775:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914102016 00000100:00100000:1.0:1788726050.437795:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914102016 00010000:00010000:1.0:1788726050.437957:0:8495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 11 pid: 6682 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726050.438342:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:1.0:1788726050.438356:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:2350:x1875614914102016:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726050.438378:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788726050.438415:0:8495:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788726050.438419:0:8495:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788726050 00002000:00010000:1.0:1788726050.438422:0:8495:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788726050 00002000:00010000:1.0:1788726050.438424:0:8495:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788726050 00010000:00010000:1.0:1788726050.438432:0:8495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 11 pid: 6682 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.438450:0:8495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 11 pid: 6682 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.438480:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c17ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0ff expref: 11 pid: 6682 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.438571:0:8495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788726050.438578:0:8495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788726050.438585:0:8495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd19a341/0xcbde9110e47c17f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.438597:0:8495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd19a341/0xcbde9110e47c17f9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.438643:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726050.438746:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:2350:x1875614914102016:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 393us (2208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726050.438754:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00010000:00010000:2.0:1788726050.438763:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bd19a341/0xcbde9110e47c17f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.438774:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd19a341/0xcbde9110e47c17f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.438805:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd19a341/0xcbde9110e47c17f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.438815:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd19a341/0xcbde9110e47c17f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.438824:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd19a341/0xcbde9110e47c17f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.438844:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921800 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726050.438849:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd19a341/0xcbde9110e47c17f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.438858:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd19a341/0xcbde9110e47c17f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.438871:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd19a341/0xcbde9110e47c17f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.438880:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd19a341/0xcbde9110e47c17f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726050.438937:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2349:x1875614914101760:12345-192.168.201.42@tcp:1:lfs.0 Request processed in 21801us (22024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726050.438945:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:2.0:1788726050.442740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726050.442844:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914102272 00000100:00100000:1.0:1788726050.442859:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914102272 00000100:00100000:3.0:1788726050.443349:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:3.0:1788726050.443367:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111086c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+38:10498:x1875614914102272:12345-192.168.201.42@tcp:35:lfs.0 00000004:00010000:3.0:1788726050.443467:0:5838:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c17eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a114 expref: 38 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788726050.444486:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788726050.444550:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788726050.454160:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788726050.454347:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1800 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.454377:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c17a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f1 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.454423:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1800 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.454485:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c17a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f1 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.454505:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c17a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f1 expref: 42 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726050.454526:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141da5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5838:1875614935091712:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726050.454678:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1012ed180 going to sleep for 11 seconds 00000100:00100000:0.0:1788726050.459444:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726050.459563:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914102400 00000100:00100000:1.0:1788726050.459577:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914102400 00010000:00010000:1.0:1788726050.459644:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c17a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f1 expref: 43 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726050.459695:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:1.0:1788726050.459707:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+43:2349:x1875614914102400:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726050.459727:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726050.459736:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c17a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f1 expref: 43 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.459753:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c17a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f1 expref: 43 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.459780:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a12bdfee00) 00010000:00010000:1.0:1788726050.459786:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1800 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.459798:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1800 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.459806:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1800 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.459828:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726050.459919:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+43:2349:x1875614914102400:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 213us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726050.459927:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00010000:00010000:3.0:1788726050.461346:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c17a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0f1 expref: 42 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726050.461377:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141da5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5838:1875614935091712:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788726050.461418:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1800 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.461429:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1800 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.461435:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1800 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788726050.461608:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788726050.462806:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788726050.463133:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875614935091840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788726050.463258:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726050.463298:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1117480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726050.463649:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935091840 00000100:00100000:0.0:1788726050.463661:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935091840 00000100:00100000:0.0:1788726050.463745:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788726050.463757:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5838:x1875614935091840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788726050.463866:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5838:x1875614935091840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 112us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726050.463881:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788726050.464447:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875614935091840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788726050.465564:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788726050.467392:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875614935091968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788726050.467500:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726050.467560:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748000 going to sleep for 11 seconds 00000100:00100000:0.0:1788726050.467891:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935091968 00000100:00100000:0.0:1788726050.467901:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935091968 00000100:00100000:0.0:1788726050.467984:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788726050.467996:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5838:x1875614935091968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788726050.468352:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5838:x1875614935091968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 358us (852us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788726050.468362:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788726050.468620:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875614935091968:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788726050.468728:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788726050.468784:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1800 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.468798:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1800 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.468807:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1800 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.468813:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726050.468819:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1800 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.468827:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1800 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.468848:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a12bdfee00) 00010000:00010000:2.0:1788726050.468851:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788726050.468858:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1800 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.468864:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1800 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788726050.469939:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788726050.470101:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788726050.470115:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345519898583ns, next at 346519895569ns, rc = 0 00000001:00080000:2.0:1788726050.470124:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788726050.470192:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a12bdfee00) 00010000:00010000:2.0:1788726050.470197:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788726050.470208:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c17eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a114 expref: 46 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726050.470387:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111086c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+45:10498:x1875614914102272:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 27026us (27659us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788726050.470399:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00000020:00080000:2.0:1788726050.470414:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788726050.476826:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726050.476929:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914102528 00000100:00100000:2.0:1788726050.476942:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914102528 00000100:00100000:2.0:1788726050.477046:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:2.0:1788726050.477059:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+45:10498:x1875614914102528:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726050.477096:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726050.477128:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1807 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a11b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.477253:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1807 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a11b expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.477271:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1807 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a11b expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.477300:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:2.0:1788726050.477303:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788726050.477308:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea400, rc 0) 00000100:00100000:2.0:1788726050.477394:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+46:10498:x1875614914102528:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 337us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726050.477430:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:0.0:1788726050.482495:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726050.482612:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914102784 00000100:00100000:1.0:1788726050.482627:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914102784 00000100:00100000:1.0:1788726050.482702:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:1.0:1788726050.482715:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+46:10498:x1875614914102784:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:1.0:1788726050.483063:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+47:10498:x1875614914102784:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 349us (581us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788726050.483072:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:1.0:1788726050.517646:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788726050.517677:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935092096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788726050.517783:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726050.518149:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935092096 00000100:00100000:2.0:1788726050.518164:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935092096 00000100:00100000:2.0:1788726050.518260:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788726050.518272:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875614935092096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788726050.518318:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788726050.518386:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875614935092096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726050.518394:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788726050.518487:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935092096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788726050.566702:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726050.566836:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914102912 00000100:00100000:0.0:1788726050.566850:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914102912 00000100:00100000:0.0:1788726050.566942:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:0.0:1788726050.566956:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+47:10508:x1875614914102912:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:0.0:1788726050.567064:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c180e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567110:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c180e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567124:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c180e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567145:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1815 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567154:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567161:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567352:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c181c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567362:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c181c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567370:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c181c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788726050.567442:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c181c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567459:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c180e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567464:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c180e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567478:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c180e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567483:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726050.567488:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c180e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567497:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c180e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567513:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726050.567516:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726050.567522:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c180e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567528:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c180e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567546:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567554:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1815 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567560:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1815 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567565:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726050.567568:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1815 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567585:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1815 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567594:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a12bdfe500) 00010000:00010000:0.0:1788726050.567596:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726050.567599:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1815 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567605:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1815 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567621:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c181c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567627:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c181c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567634:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c181c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567639:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726050.567642:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c181c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567647:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c181c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567654:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:0.0:1788726050.567656:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726050.567660:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c181c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.567676:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c181c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726050.569163:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+47:10508:x1875614914102912:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 2197us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726050.569180:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:0.0:1788726050.597910:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726050.598620:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914103168 00000100:00100000:2.0:1788726050.598637:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914103168 00000100:00100000:2.0:1788726050.598720:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:2.0:1788726050.598735:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+47:10511:x1875614914103168:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726050.598763:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726050.598791:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1823 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a122 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.598890:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c182a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.598909:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c182a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.598922:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c182a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.598940:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1831 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.598971:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.598978:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.599113:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1838 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.599120:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.599124:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726050.599133:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788726050.599262:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c182a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.599268:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c182a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.599273:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c182a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.599277:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726050.599281:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c182a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.599286:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c182a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.601946:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:2.0:1788726050.601959:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726050.601972:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c182a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.601982:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c182a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.602009:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.602013:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1831 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.602019:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.602022:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726050.602026:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.602031:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1831 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.602044:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a11214ca00) 00010000:00010000:2.0:1788726050.602045:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726050.602047:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1831 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.602050:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1831 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.602146:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1823 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a122 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.602159:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a122 expref: 49 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.602165:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:2.0:1788726050.602166:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726050.602168:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eae00, rc 0) 00000100:00100000:2.0:1788726050.602300:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+49:10511:x1875614914103168:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 3568us (4420us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788726050.602308:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:1.0:1788726050.606000:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726050.606092:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914103296 00000100:00100000:2.0:1788726050.606103:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914103296 00000100:00100000:2.0:1788726050.606166:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 103 00000100:00100000:2.0:1788726050.606174:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+49:10511:x1875614914103296:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:2.0:1788726050.606288:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1846 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.606305:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.606315:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.606342:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.606364:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1846 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.606369:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.606373:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726050.606377:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.606382:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1846 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.606393:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:2.0:1788726050.606397:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788726050.606402:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1846 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.606417:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1846 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726050.606704:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+49:10511:x1875614914103296:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 527us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726050.606715:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 103 00000100:00100000:3.0:1788726050.610111:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726050.610770:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914103552 00000100:00100000:2.0:1788726050.610788:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914103552 00000100:00100000:2.0:1788726050.610977:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:2.0:1788726050.610991:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+49:10511:x1875614914103552:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:2.0:1788726050.611363:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+50:10511:x1875614914103552:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 373us (1266us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788726050.611390:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:3.0:1788726050.670493:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726050.670733:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914103808 00000100:00100000:0.0:1788726050.670748:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914103808 00000100:00100000:0.0:1788726050.670946:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 104 00000100:00100000:0.0:1788726050.670960:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+50:10521:x1875614914103808:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788726050.670997:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726050.671001:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788726050.671035:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c17c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a106 expref: 50 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.671061:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726050.671066:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788726050.671083:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c184d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a129 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.671352:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.671371:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1838 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a122 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.671423:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.671469:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a122 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.671635:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1838 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a122 expref: 50 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726050.671654:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935092224:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726050.671786:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a110318600 going to sleep for 11 seconds 00000100:00100000:3.0:1788726050.675056:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726050.675399:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935092224:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726050.675444:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726050.675747:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914103936 00000100:00100000:2.0:1788726050.675759:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914103936 00010000:00010000:2.0:1788726050.675807:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1838 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a122 expref: 51 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726050.676134:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:2.0:1788726050.676147:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+51:2349:x1875614914103936:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726050.676169:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726050.676178:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1838 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a122 expref: 51 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.676191:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a122 expref: 51 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.676259:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1838 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a122 expref: 51 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.676280:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:2.0:1788726050.676286:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.676298:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.676353:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.676735:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726050.676806:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+50:2349:x1875614914103936:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 659us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726050.676816:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 52 00010000:00010000:3.0:1788726050.677360:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.677372:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726050.677417:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788726050.677767:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c184d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a129 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.677791:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a129 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.677800:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:3.0:1788726050.677803:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788726050.677807:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725200, rc 0) 00000100:00100000:3.0:1788726050.677972:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+50:10521:x1875614914103808:12345-192.168.201.42@tcp:101:bash.0 Request processed in 7014us (7503us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788726050.677982:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 104 00000100:00100000:3.0:1788726050.684711:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726050.685374:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914104192 00000100:00100000:2.0:1788726050.685460:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914104192 00000100:00100000:2.0:1788726050.685642:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:2.0:1788726050.685656:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+50:10521:x1875614914104192:12345-192.168.201.42@tcp:36:bash.0 00010000:00010000:2.0:1788726050.686276:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1862 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.686303:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1862 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.686319:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1862 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788726050.686385:0:7629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788726050.686433:0:7629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007937e6c5 reply state 000000003c599edb transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1862 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726050.686443:0:7629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788726050.686594:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+53:10521:x1875614914104192:12345-192.168.201.42@tcp:36:bash.0 Request processed in 938us (1897us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788726050.686605:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 105 00000020:00080000:2.0:1788726050.686619:0:7629:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788726050.689436:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1862 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.689460:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1862 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.689468:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1862 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.689475:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eae00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726050.689490:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1862 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.689499:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1862 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.689545:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:1.0:1788726050.689549:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726050.689554:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1862 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.689561:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1862 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726050.692122:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726050.692904:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914104320 00000100:00100000:0.0:1788726050.692920:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914104320 00000100:00100000:0.0:1788726050.693008:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:0.0:1788726050.693020:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+52:10521:x1875614914104320:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788726050.693057:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726050.693084:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1869 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a130 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.693267:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.693288:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a129 expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.693306:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.693354:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a129 expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.693370:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a129 expref: 53 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726050.693810:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875614935092352:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726050.694102:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a110318600 going to sleep for 11 seconds 00000100:00100000:0.0:1788726050.698891:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875614935092352:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726050.698932:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726050.700111:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726050.700923:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914104448 00000100:00100000:1.0:1788726050.700939:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914104448 00010000:00010000:1.0:1788726050.701000:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a129 expref: 54 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726050.701096:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:1.0:1788726050.701108:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+54:2349:x1875614914104448:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726050.701140:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726050.701149:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a129 expref: 54 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.701165:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a129 expref: 54 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.701194:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1854 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a129 expref: 54 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.701265:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:1.0:1788726050.701271:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.701301:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.701310:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.701346:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726050.701441:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+53:2349:x1875614914104448:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 334us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726050.701450:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 53 00010000:00010000:0.0:1788726050.701528:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.701537:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726050.701620:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788726050.701626:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788726050.701655:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.701707:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1869 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a130 expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.701742:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a130 expref: 52 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726050.701749:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:0.0:1788726050.701752:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788726050.701754:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724c00, rc 0) 00000100:00100000:0.0:1788726050.701788:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+52:10521:x1875614914104320:12345-192.168.201.42@tcp:101:bash.0 Request processed in 8771us (9683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726050.701796:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:3.0:1788726050.714385:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726050.714551:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914104704 00000100:00100000:0.0:1788726050.714572:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914104704 00000100:00100000:0.0:1788726050.714653:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:0.0:1788726050.714676:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+52:10521:x1875614914104704:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:0.0:1788726050.715023:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+53:10521:x1875614914104704:12345-192.168.201.42@tcp:35:bash.0 Request processed in 358us (652us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788726050.715033:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:0.0:1788726050.781125:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726050.781269:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914104832 00000100:00100000:3.0:1788726050.781315:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914104832 00000100:00100000:3.0:1788726050.781415:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 107 00000100:00100000:3.0:1788726050.781428:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+53:10527:x1875614914104832:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726050.781465:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726050.781496:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c1877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a137 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.781591:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c187e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.781621:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c187e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.781638:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c187e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726050.782180:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788726050.782187:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788726050.782241:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c187e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.782279:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c1877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a137 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.782312:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c187e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a137 expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.782323:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726050.782327:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788726050.782332:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915600, rc 0) 00000100:00100000:3.0:1788726050.783078:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+54:10527:x1875614914104832:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1648us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726050.783087:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 107 00000100:00100000:3.0:1788726050.787674:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726050.787874:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914104960 00000100:00100000:1.0:1788726050.787888:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914104960 00000100:00100000:1.0:1788726050.787969:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:1.0:1788726050.787983:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+54:10527:x1875614914104960:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788726050.788013:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726050.788042:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1885 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a13e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788133:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c188c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788152:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c188c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788179:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c188c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788197:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1893 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788257:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788265:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788390:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c189a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788408:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c189a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788416:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c189a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726050.788462:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788726050.788467:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788726050.788490:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c189a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788504:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c189a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788512:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c188c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788518:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c188c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788526:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c188c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788542:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726050.788548:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c188c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788557:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c188c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788879:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:1.0:1788726050.788884:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726050.788890:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c188c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788898:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c188c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788915:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788920:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1893 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788926:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788932:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726050.788935:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788942:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1893 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788960:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a10d14d000) 00010000:00010000:1.0:1788726050.788963:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726050.788966:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1893 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.788973:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1893 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.789014:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1885 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a13e expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.789029:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c189a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a13e expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.789037:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:1.0:1788726050.789039:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788726050.789042:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920c00, rc 0) 00000100:00100000:1.0:1788726050.789379:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:10527:x1875614914104960:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1398us (1726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726050.789389:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:3.0:1788726050.794288:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726050.794338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726050.794427:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914105344 00000100:00100000:1.0:1788726050.794441:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914105344 00000100:00100000:1.0:1788726050.794521:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:1.0:1788726050.794533:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:2351:x1875614914105344:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726050.794554:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726050.794598:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c189a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a13e expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.794657:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:1.0:1788726050.794672:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726050.795067:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914105216 00000100:00100000:2.0:1788726050.795073:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914105216 00000100:00100000:1.0:1788726050.795077:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:2351:x1875614914105344:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 545us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726050.795086:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:2.0:1788726050.795109:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:2.0:1788726050.795124:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+54:10527:x1875614914105216:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726050.795147:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726050.795168:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c18a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a145 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.795314:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.795329:0:7629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a130 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.795338:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.795382:0:7629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a130 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.795396:0:7629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a130 expref: 55 pid: 5836 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726050.795423:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935092480:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788726050.795506:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726050.799954:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726050.800517:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914105472 00000100:00100000:0.0:1788726050.800533:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914105472 00010000:00010000:0.0:1788726050.800607:0:8495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a130 expref: 56 pid: 5836 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726050.800745:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:3.0:1788726050.800764:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+56:2350:x1875614914105472:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726050.800785:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726050.800796:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a130 expref: 56 pid: 5836 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.800813:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a130 expref: 56 pid: 5836 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.800842:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:3.0:1788726050.800850:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.800861:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.800869:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726050.800893:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726050.800968:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+56:2350:x1875614914105472:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 211us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726050.800997:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 54 00010000:00010000:1.0:1788726050.802290:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1870 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a130 expref: 55 pid: 5836 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726050.802321:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935092480:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788726050.802352:0:7629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.802364:0:7629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.802370:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726050.802395:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788726050.802841:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c18a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a145 expref: 56 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.802860:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a145 expref: 55 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.802870:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:1.0:1788726050.802873:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788726050.802892:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eac00, rc 0) 00000100:00100000:1.0:1788726050.807282:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:10527:x1875614914105216:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 12138us (12989us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788726050.807301:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:3.0:1788726050.810884:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726050.810991:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914105728 00000100:00100000:1.0:1788726050.811006:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914105728 00000100:00100000:1.0:1788726050.811085:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:1.0:1788726050.811093:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1128e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:10527:x1875614914105728:12345-192.168.201.42@tcp:103:lfs.0 00010000:00010000:1.0:1788726050.811111:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726050.811147:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1807 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a11b expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.811172:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:1.0:1788726050.811177:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726050.811270:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1128e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+54:10527:x1875614914105728:12345-192.168.201.42@tcp:103:lfs.0 Request processed in 177us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726050.811275:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:0.0:1788726050.816438:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726050.816573:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914105856 00000100:00100000:2.0:1788726050.816587:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914105856 00000100:00100000:2.0:1788726050.816668:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:2.0:1788726050.816679:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+54:10527:x1875614914105856:12345-192.168.201.42@tcp:58:lfs.0 00010000:00010000:2.0:1788726050.816823:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c18b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.816870:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c18b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726050.816884:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c18b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788726050.817122:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788726050.817265:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+54:10527:x1875614914105856:12345-192.168.201.42@tcp:58:lfs.0 Request processed in 586us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726050.817273:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:1.0:1788726050.820392:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726050.820470:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914105984 00000100:00100000:3.0:1788726050.820483:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914105984 00000100:00100000:1.0:1788726050.820595:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 111 00000100:00100000:1.0:1788726050.820609:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+54:10527:x1875614914105984:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788726050.820637:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726050.820663:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c18bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a14c expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.820743:0:7629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c18b6 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.820777:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c18bd lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a14c expref: 55 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.820799:0:7629:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c18b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.820810:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c18bd lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a14c expref: 55 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.820823:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:1.0:1788726050.820825:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788726050.820828:0:7629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c18bd lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a14c expref: 55 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726050.820833:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920c00, rc 0) 00000100:00100000:1.0:1788726050.820901:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:10527:x1875614914105984:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 295us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726050.820908:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 111 00010000:00010000:1.0:1788726050.838026:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788726051.221576:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788726051.221590:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788726051.221667:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788726051.221674:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788726051.221849:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ad52d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875614935092608:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788726051.222005:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a107aa39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726051.227978:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ad52d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875614935092608:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788726051.238032:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726051.240202:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914106112 00000100:00100000:2.0:1788726051.240248:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914106112 00000100:00100000:2.0:1788726051.240368:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00100000:2.0:1788726051.240384:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:10528:x1875614914106112:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788726051.240444:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788726051.240623:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:10528:x1875614914106112:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 242us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726051.240633:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 112 00000100:00080000:1.0:1788726051.242487:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726051.244041:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726051.244158:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914106240 00000100:00100000:3.0:1788726051.244181:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914106240 00000100:00100000:3.0:1788726051.244290:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00100000:3.0:1788726051.244302:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:10528:x1875614914106240:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788726051.244418:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c18c4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.244439:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c18c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.244455:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c18c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247238:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c18cb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247264:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c18cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247279:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c18cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247316:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c18d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247326:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c18d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247346:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c18d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726051.247409:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788726051.247414:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788726051.247430:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c18d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247442:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c18c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247448:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c18c4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247455:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c18c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247461:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726051.247466:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c18c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247473:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c18c4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247486:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:3.0:1788726051.247489:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726051.247493:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c18c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247499:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c18c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247527:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c18cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247533:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c18cb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247539:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c18cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247544:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726051.247546:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c18cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247551:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c18cb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247558:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff91a111639b00) 00010000:00010000:3.0:1788726051.247560:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726051.247563:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c18cb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247568:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c18cb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247584:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c18d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247589:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c18d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247594:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c18d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247605:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726051.247608:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c18d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247614:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c18d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247622:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:3.0:1788726051.247624:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726051.247627:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c18d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.247633:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c18d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726051.247725:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:10528:x1875614914106240:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 3421us (3691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726051.247735:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 113 00000100:00100000:0.0:1788726051.258036:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726051.258176:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914106496 00000100:00100000:3.0:1788726051.258186:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914106496 00000100:00100000:3.0:1788726051.258264:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:3.0:1788726051.258276:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:10528:x1875614914106496:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726051.258298:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726051.258318:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c18d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a153 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.258438:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c18e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.258465:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c18e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.258476:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c18e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726051.258489:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788726051.258595:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c18e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.258602:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c18e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.258608:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c18e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.258614:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726051.258618:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c18e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.258625:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c18e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.258647:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:3.0:1788726051.258651:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788726051.258655:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c18e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.258661:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c18e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.258704:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c18d9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a153 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.258721:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:3.0:1788726051.258724:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788726051.258728:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c18d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a153 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.258738:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914200, rc 0) 00000100:00100000:3.0:1788726051.258801:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+56:10528:x1875614914106496:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 526us (778us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1788726051.258808:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 114 00000100:00100000:0.0:1788726051.263345:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726051.263466:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914106624 00000100:00100000:1.0:1788726051.263476:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914106624 00000100:00100000:1.0:1788726051.263542:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:1.0:1788726051.263552:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+56:10528:x1875614914106624:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788726051.263594:0:7629:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788726051.263983:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+56:10528:x1875614914106624:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 431us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726051.263992:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 115 00000100:00100000:1.0:1788726051.270602:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726051.270872:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914106880 00000100:00100000:3.0:1788726051.270884:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914106880 00000100:00100000:3.0:1788726051.270947:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:3.0:1788726051.270958:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+56:10528:x1875614914106880:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726051.270980:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726051.270984:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788726051.271013:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c187e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a137 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.271033:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726051.271041:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788726051.271055:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c18ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a15a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788726051.273880:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788726051.275466:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c18f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.275493:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c18f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.275508:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c18f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.276006:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c18ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a15a expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.276033:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c18f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a15a expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.276042:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a11214ca00) 00010000:00010000:2.0:1788726051.276045:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726051.276050:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eaa00, rc 0) 00000100:00100000:2.0:1788726051.276247:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+57:10528:x1875614914106880:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 5289us (5654us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788726051.276260:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 116 00000100:00100000:1.0:1788726051.287288:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726051.287377:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914107136 00000100:00100000:3.0:1788726051.287391:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914107136 00000100:00100000:3.0:1788726051.287490:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:3.0:1788726051.287502:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+57:10528:x1875614914107136:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788726051.287575:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726051.287603:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c18f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a15a expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.287624:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a11214ca00) 00010000:00010000:3.0:1788726051.287831:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788726051.287856:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1903 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.287871:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1903 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.287882:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1903 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.287916:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c190a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb7f4b244 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.287924:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c190a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb7f4b244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.287931:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c190a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb7f4b244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.287996:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1903 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.288003:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1903 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.288022:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1903 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.288028:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726051.288033:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1903 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.288041:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1903 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.288051:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726051.288053:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726051.288057:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1903 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.288063:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1903 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.288071:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c190a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb7f4b244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.288077:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c190a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb7f4b244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.288082:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c190a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb7f4b244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.288086:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726051.288089:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c190a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb7f4b244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.288103:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c190a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb7f4b244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.288111:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb7f4b244 (ffff91a111639b00) 00010000:00010000:3.0:1788726051.288113:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726051.288116:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c190a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb7f4b244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.288121:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c190a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb7f4b244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726051.288290:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+56:10528:x1875614914107136:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 788us (1010us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788726051.288300:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 117 00000100:00100000:0.0:1788726051.300421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726051.300919:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914107264 00000100:00100000:2.0:1788726051.300934:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914107264 00000100:00100000:2.0:1788726051.301093:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:2.0:1788726051.301107:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+56:10528:x1875614914107264:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726051.301137:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726051.301185:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1911 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a161 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.301269:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1918 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.301287:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.301302:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.301459:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1911 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a161 expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.301486:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1918 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a161 expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.301496:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a11214ca00) 00010000:00010000:2.0:1788726051.301500:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788726051.301504:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea600, rc 0) 00000100:00100000:2.0:1788726051.301737:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+57:10528:x1875614914107264:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 632us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726051.301747:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 118 00000100:00100000:3.0:1788726051.310356:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726051.311031:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914107520 00000100:00100000:2.0:1788726051.311048:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914107520 00000100:00100000:2.0:1788726051.311137:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:2.0:1788726051.311152:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+57:10528:x1875614914107520:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788726051.311324:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c191f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.311347:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c191f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.311361:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c191f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788726051.311764:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788726051.311779:0:7629:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346361562583ns, next at 347361557958ns, rc = 0 00000004:00010000:2.0:1788726051.312174:0:7629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcdbef10 reply state 0000000019a63f62 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c191f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726051.312186:0:7629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788726051.312365:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+59:10528:x1875614914107520:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 1214us (2017us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788726051.312375:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 119 00000100:00100000:1.0:1788726051.317490:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726051.317570:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914107648 00000100:00100000:3.0:1788726051.317585:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914107648 00010000:00010000:2.0:1788726051.317888:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c191f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.317905:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c191f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.317915:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c191f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.317923:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726051.317931:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c191f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.317940:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c191f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.317964:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a11214ca00) 00010000:00010000:2.0:1788726051.317968:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788726051.317974:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c191f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.317984:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c191f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726051.318063:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:3.0:1788726051.318078:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+58:10528:x1875614914107648:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726051.318106:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726051.318130:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1926 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a168 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.318197:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1926 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a168 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.318212:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1926 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a168 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.318278:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a11214ca00) 00010000:00010000:3.0:1788726051.318284:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788726051.318289:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915800, rc 0) 00000100:00100000:2.0:1788726051.318437:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+59:10528:x1875614914107648:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 359us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726051.318461:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 120 00000100:00100000:0.0:1788726051.327083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726051.327364:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914107776 00000100:00100000:1.0:1788726051.327445:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914107776 00000100:00100000:0.0:1788726051.327878:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:0.0:1788726051.327892:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2350:x1875614914107776:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788726051.328356:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2350:x1875614914107776:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 464us (1287us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788726051.328367:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00080000:1.0:1788726051.331099:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788726051.332433:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726051.333066:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914108032 00000100:00100000:0.0:1788726051.333082:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914108032 00000100:00100000:0.0:1788726051.333162:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:0.0:1788726051.333175:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+59:10528:x1875614914108032:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788726051.333582:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+60:10528:x1875614914108032:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 408us (1160us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788726051.333592:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:0.0:1788726051.337432:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726051.337901:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914108288 00000100:00100000:3.0:1788726051.337917:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914108288 00000100:00100000:3.0:1788726051.338060:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:3.0:1788726051.338073:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+60:10528:x1875614914108288:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788726051.338312:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+60:10528:x1875614914108288:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 233us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726051.338321:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:3.0:1788726051.344103:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726051.344579:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914108416 00000100:00100000:2.0:1788726051.344595:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914108416 00000100:00100000:2.0:1788726051.344699:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:2.0:1788726051.344711:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+60:10528:x1875614914108416:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726051.344741:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726051.344770:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c192d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a16f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.344881:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1934 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.344900:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.344914:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726051.344962:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726051.344986:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.345020:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c192d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a16f expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.345044:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1934 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a16f expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.345053:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a11214ca00) 00010000:00010000:2.0:1788726051.345075:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788726051.345080:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ebe00, rc 0) 00000100:00100000:2.0:1788726051.345179:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+61:10528:x1875614914108416:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 469us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726051.345187:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 122 00000100:00100000:1.0:1788726051.351885:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726051.352052:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914108544 00000100:00100000:3.0:1788726051.352065:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914108544 00000100:00100000:3.0:1788726051.352147:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:3.0:1788726051.352161:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2349:x1875614914108544:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726051.352190:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726051.352268:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f403e738/0xcbde9110e47c193b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a176 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726051.352308:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9dcb23, blocks: 0x1 00010000:00010000:3.0:1788726051.352336:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1788726051.352342:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726051.352354:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f403e738/0xcbde9110e47c193b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a176 expref: 10 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.352423:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f403e738/0xcbde9110e47c193b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a176 expref: 10 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.352440:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915600, rc 0) 00000100:00100000:3.0:1788726051.352525:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:2349:x1875614914108544:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 367us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726051.352533:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:0.0:1788726051.357982:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726051.358097:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914108800 00000100:00100000:2.0:1788726051.358110:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914108800 00000100:00100000:2.0:1788726051.358185:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:2.0:1788726051.358197:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+61:10528:x1875614914108800:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788726051.358387:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+61:10528:x1875614914108800:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 184us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726051.358404:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:0.0:1788726051.367553:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726051.368056:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914108928 00000100:00100000:2.0:1788726051.368072:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914108928 00000100:00100000:2.0:1788726051.368156:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:2.0:1788726051.368364:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:10528:x1875614914108928:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726051.368406:0:9742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726051.368432:0:9742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1942 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a17d expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.368479:0:9742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f403e738/0xcbde9110e47c193b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a176 expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.368490:0:9742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726051.368495:0:9742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726051.368502:0:9742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1942 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a17d expref: 11 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.368931:0:9742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f403e738/0xcbde9110e47c193b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a176 expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.368951:0:9742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f403e738/0xcbde9110e47c193b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a176 expref: 11 pid: 6680 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726051.368967:0:9742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9742:1875614935092736:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788726051.369138:0:9742:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788726051.379040:0:9742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9742:1875614935092736:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726051.379097:0:9742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1942 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a17d expref: 11 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.379126:0:9742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea200, rc 0) 00000100:00100000:2.0:1788726051.379208:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:10528:x1875614914108928:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 11040us (11669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726051.379259:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:0.0:1788726051.381574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726051.384000:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914109056 00000100:00100000:2.0:1788726051.384023:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914109056 00010000:00010000:2.0:1788726051.384089:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f403e738/0xcbde9110e47c193b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a176 expref: 11 pid: 6680 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726051.384147:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:2.0:1788726051.384158:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:2349:x1875614914109056:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726051.384204:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726051.384271:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f403e738/0xcbde9110e47c193b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a176 expref: 11 pid: 6680 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.384287:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f403e738/0xcbde9110e47c193b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a176 expref: 11 pid: 6680 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.384451:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f403e738/0xcbde9110e47c193b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a176 expref: 11 pid: 6680 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.384474:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726051.384479:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726051.384488:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1942 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a17d expref: 10 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.384499:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1942 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a17d expref: 10 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.384767:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1942 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a17d expref: 10 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726051.384786:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875614935092864:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788726051.385574:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788726051.392958:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875614935092864:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788726051.392995:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726051.393093:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:2349:x1875614914109056:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 8933us (11531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726051.393107:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:1.0:1788726051.404546:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726051.404918:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914109184 00000100:00100000:0.0:1788726051.404932:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914109184 00002000:00100000:0.0:1788726051.405004:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff91a13b025f80 x1875614914109184/t0(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:447/0 lens 504/0 e 0 to 0 dl 1788726062 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788726051.405018:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13b025f80 with x1875614914109184 ext(0->12) 00002000:00010000:0.0:1788726051.405025:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a13b025f80 00000100:00100000:0.0:1788726051.405086:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:0.0:1788726051.405097:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:2349:x1875614914109184:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788726051.406289:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+12:2349:x1875614914109184:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 1181us (1747us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788726051.406862:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00002000:00100000:0.0:1788726051.406885:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff91a13b025f80 x1875614914109184/t4294967308(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:447/0 lens 504/448 e 0 to 0 dl 1788726062 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788726051.406896:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13b025f80 with x1875614914109184 ext(0->12) 00002000:00010000:0.0:1788726051.406903:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a13b025f80 00000100:00100000:0.0:1788726051.411798:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726051.411919:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914109312 00000100:00100000:2.0:1788726051.411932:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914109312 00000100:00100000:2.0:1788726051.412014:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:2.0:1788726051.412027:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+61:10528:x1875614914109312:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788726051.460073:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:0.0:1788726051.460140:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a12ae09840 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788726051.460147:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a112838600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a12ae099c0 00000020:00080000:0.0:1788726051.460152:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a112838000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a13ab2b000 00000004:00080000:0.0:1788726051.460183:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788726051.460242:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788726051.460260:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a1117480c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788726051.460264:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a12ae2bb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a111748600 00000020:00080000:0.0:1788726051.460266:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a12ae2b300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a139cee000 00000004:00080000:0.0:1788726051.460274:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788726051.460767:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935092992:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788726051.460859:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726051.460961:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935093120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788726051.461001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726051.461025:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788726051.461031:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13aef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935093248:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788726051.461052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726051.461089:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935092992 00000100:00100000:0.0:1788726051.461098:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935092992 00000100:00100000:0.0:1788726051.461152:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935093120 00000100:00100000:0.0:1788726051.461155:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935093120 00000100:00100000:0.0:1788726051.461166:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935093248 00000100:00100000:0.0:1788726051.461169:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935093248 00000100:00100000:0.0:1788726051.461188:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788726051.461198:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1875614935092992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788726051.461276:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1788726051.461314:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e34421f/0xcbde9110e47c1949 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.461345:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6138ba1/0xcbde9110e47c170b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0dc expref: 11 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.461356:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788726051.461362:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788726051.461367:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e34421f/0xcbde9110e47c1949 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.461422:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6138ba1/0xcbde9110e47c170b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0dc expref: 11 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.461440:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6138ba1/0xcbde9110e47c170b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0dc expref: 11 pid: 6683 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726051.461465:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13aef8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875614935093376:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726051.461956:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1103183c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726051.461982:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788726051.461993:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1875614935093120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788726051.462201:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788726051.462206:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788726051 00002000:00010000:0.0:1788726051.462209:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788726051.462211:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788726051 -> 1788726051 00002000:00010000:0.0:1788726051.462240:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788726051.462310:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3304:x1875614935093120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 319us (1307us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788726051.462319:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788726051.462346:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788726051.462354:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3304:x1875614935093248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788726051.462369:0:6683:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00000020:00080000:1.0:1788726051.462495:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788726051.462746:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788726051.465879:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13aef8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875614935093376:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788726051.465928:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e34421f/0xcbde9110e47c1949 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726051.466093:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9dcb22, atime: 0x6a9dcb22, ctime: 0x6a9dcb22, blocks: 0x1 00010000:00010000:0.0:1788726051.466104:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1950 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.466122:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=346s v=(0 0) 00010000:00010000:0.0:1788726051.466127:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726051.466136:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.466184:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.466198:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.466207:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1950 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.466246:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788726051.467117:0:8494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726051.467129:0:8494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1950 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.467141:0:8494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726051.467160:0:8494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1950 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.467171:0:8494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1950 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.467197:0:8494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1950 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.467205:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1950 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.467262:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726051.467264:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726051.467266:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726051.468692:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726051.469342:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914109440 00000100:00100000:1.0:1788726051.469359:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914109440 00010000:00010000:1.0:1788726051.469440:0:8495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6138ba1/0xcbde9110e47c170b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0dc expref: 12 pid: 6683 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726051.469492:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:1.0:1788726051.469516:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+12:2350:x1875614914109440:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726051.469540:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726051.469548:0:8495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6138ba1/0xcbde9110e47c170b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0dc expref: 12 pid: 6683 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.469564:0:8495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6138ba1/0xcbde9110e47c170b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0dc expref: 12 pid: 6683 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.469622:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6138ba1/0xcbde9110e47c170b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.42@tcp remote: 0x228275be9055a0dc expref: 12 pid: 6683 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.469646:0:8495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788726051.469847:0:8495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788726051.469857:0:8495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e34421f/0xcbde9110e47c1949 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.469870:0:8495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e34421f/0xcbde9110e47c1949 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.469906:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726051.469984:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:2350:x1875614914109440:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 481us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726051.469993:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 56 00010000:00010000:1.0:1788726051.471533:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e34421f/0xcbde9110e47c1949 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.471554:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e34421f/0xcbde9110e47c1949 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.471566:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e34421f/0xcbde9110e47c1949 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.471575:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e34421f/0xcbde9110e47c1949 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.471610:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788726051.472296:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3307:x1875614935092992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11092us (11430us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788726051.472311:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1788726051.472355:0:8493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726051.472364:0:8493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e34421f/0xcbde9110e47c1949 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.472375:0:8493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726051.472381:0:8493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e34421f/0xcbde9110e47c1949 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.472401:0:8493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e34421f/0xcbde9110e47c1949 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.472426:0:8493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e34421f/0xcbde9110e47c1949 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.472434:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e34421f/0xcbde9110e47c1949 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.472459:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726051.472461:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726051.472463:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726051.474360:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:10528:x1875614914109312:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 62320us (62562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726051.474579:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 124 00000100:00100000:0.0:1788726051.476181:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3304:x1875614935093248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13815us (15115us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788726051.476201:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000004:00080000:0.0:1788726051.476328:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a13aef9c00/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788726051.476336:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13aef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935093248:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788726051.476356:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a1116a3b80/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788726051.476362:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935093120:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1788726051.476418:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a1116a0000/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788726051.476423:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935092992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788726051.483671:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726051.483858:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914109568 00000100:00100000:2.0:1788726051.483873:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914109568 00000100:00100000:2.0:1788726051.483949:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:2.0:1788726051.483962:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:2350:x1875614914109568:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788726051.536158:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:2350:x1875614914109568:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 52182us (52494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726051.536196:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00000001:00080000:3.0:1788726051.537615:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788726051.537637:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1788726051.537814:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:1.0:1788726051.540921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726051.541347:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914109824 00000100:00100000:2.0:1788726051.541362:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914109824 00000100:00100000:2.0:1788726051.541466:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:2.0:1788726051.541480:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:10528:x1875614914109824:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788726051.541993:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726051.542032:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1934 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a16f expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.542059:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a11214ca00) 00010000:00010000:2.0:1788726051.542128:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788726051.542176:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1957 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.542274:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.542287:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788726051.542936:0:7629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006035c041 reply state 00000000dc8b521f transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726051.542950:0:7629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788726051.543298:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:10528:x1875614914109824:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 1817us (2389us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788726051.543309:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 125 00000100:00100000:3.0:1788726051.544147:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13aefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935093504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788726051.544251:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726051.544517:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935093504 00000100:00100000:0.0:1788726051.544529:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935093504 00000100:00100000:0.0:1788726051.544591:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788726051.544611:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3306:x1875614935093504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788726051.544637:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726051.544721:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3306:x1875614935093504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726051.544728:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788726051.544781:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13aefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935093504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788726051.561121:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726051.561166:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914109952 00000100:00100000:0.0:1788726051.561180:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914109952 00000100:00100000:0.0:1788726051.561265:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:0.0:1788726051.561279:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914109952:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788726051.562071:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788726051.562080:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788726051 -> 1788726050 00002000:00010000:0.0:1788726051.562083:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788726050 00002000:00010000:0.0:1788726051.562085:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788726051 -> 1788726050 00002000:00010000:0.0:1788726051.562088:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788726051.562180:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914109952:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 901us (1068us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788726051.562191:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00010000:00010000:3.0:1788726051.566468:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.566492:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1957 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.566501:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1957 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.566518:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726051.566524:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1957 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.566534:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1957 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.566577:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a11214ca00) 00010000:00010000:3.0:1788726051.566581:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726051.566588:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1957 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.566595:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1957 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726051.566995:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726051.567190:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914110208 00000100:00100000:0.0:1788726051.567204:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914110208 00000100:00100000:0.0:1788726051.567322:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:0.0:1788726051.567335:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:10528:x1875614914110208:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788726051.567451:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c195e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.567470:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1918 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a161 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.567495:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c195e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.567811:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1918 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a161 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.567829:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1918 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a161 expref: 15 pid: 5836 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726051.567847:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13aef9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875614935093632:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726051.567972:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a110318240 going to sleep for 11 seconds 00000100:00100000:0.0:1788726051.571290:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726051.571929:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914110336 00000100:00100000:3.0:1788726051.571943:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914110336 00010000:00010000:3.0:1788726051.572002:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1918 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a161 expref: 16 pid: 5836 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726051.572056:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:3.0:1788726051.572078:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aefb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:2350:x1875614914110336:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726051.572099:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726051.572107:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1918 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a161 expref: 16 pid: 5836 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.572124:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1918 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a161 expref: 16 pid: 5836 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.572152:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a11214ca00) 00010000:00010000:3.0:1788726051.572158:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c195e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.572169:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c195e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.572202:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c195e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.572244:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726051.572327:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aefb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:2350:x1875614914110336:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 260us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726051.572335:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 57 00010000:00010000:1.0:1788726051.572987:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1918 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a161 expref: 15 pid: 5836 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726051.573007:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13aef9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875614935093632:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788726051.573036:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c195e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.573047:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c195e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.573054:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c195e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.574289:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c195e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.574360:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c195e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.574369:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c195e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.574444:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726051.574450:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c195e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.574459:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c195e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.574499:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a11214ca00) 00010000:00010000:1.0:1788726051.574502:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788726051.574714:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c195e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.574722:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c195e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726051.574830:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:10528:x1875614914110208:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 7493us (7837us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788726051.574842:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 126 00000100:00100000:0.0:1788726051.583787:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726051.583979:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914110464 00000100:00100000:1.0:1788726051.583994:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914110464 00000100:00100000:1.0:1788726051.584062:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:1.0:1788726051.584075:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2352:x1875614914110464:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788726051.584136:0:9742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005537ebe4/0xcbde9110e47c1965 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.584162:0:9742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1942 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a17d expref: 7 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.584182:0:9742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726051.584187:0:9742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788726051.584193:0:9742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005537ebe4/0xcbde9110e47c1965 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.584268:0:9742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1942 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a17d expref: 7 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.584296:0:9742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1942 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a17d expref: 7 pid: 9742 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726051.584316:0:9742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a869c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9742:1875614935093760:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788726051.584438:0:9742:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a107aa3480 going to sleep for 11 seconds 00000100:00100000:2.0:1788726051.591209:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726051.591257:0:9742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a869c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9742:1875614935093760:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788726051.591262:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914110592 00000100:00100000:2.0:1788726051.591270:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914110592 00010000:00010000:1.0:1788726051.591294:0:9742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005537ebe4/0xcbde9110e47c1965 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.591315:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1942 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a17d expref: 8 pid: 9742 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726051.591361:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:2.0:1788726051.591372:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2349:x1875614914110592:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726051.591401:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726051.591431:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1942 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a17d expref: 8 pid: 9742 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.591448:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1942 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a17d expref: 8 pid: 9742 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.591503:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1942 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a17d expref: 8 pid: 9742 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.591525:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788726051.591531:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788726051.591538:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005537ebe4/0xcbde9110e47c1965 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.591548:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005537ebe4/0xcbde9110e47c1965 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.591577:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788726051.591601:0:9742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005537ebe4/0xcbde9110e47c1965 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.591610:0:9742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005537ebe4/0xcbde9110e47c1965 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.591638:0:9742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005537ebe4/0xcbde9110e47c1965 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.591647:0:9742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005537ebe4/0xcbde9110e47c1965 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726051.591652:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914110592:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 282us (457us total) trans 0 rc 0/0 00010000:00010000:1.0:1788726051.591656:0:9742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005537ebe4/0xcbde9110e47c1965 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726051.591660:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 58 00010000:00010000:1.0:1788726051.591678:0:9742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920a00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726051.591684:0:9742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005537ebe4/0xcbde9110e47c1965 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.591694:0:9742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005537ebe4/0xcbde9110e47c1965 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.591709:0:9742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005537ebe4/0xcbde9110e47c1965 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.591718:0:9742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005537ebe4/0xcbde9110e47c1965 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726051.591774:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2352:x1875614914110464:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 7702us (8001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726051.591782:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:1.0:1788726051.601185:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726051.601271:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914110848 00000100:00100000:3.0:1788726051.601285:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914110848 00000100:00100000:3.0:1788726051.601354:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 127 00000100:00100000:3.0:1788726051.601367:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:10528:x1875614914110848:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788726051.601489:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c196c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.601527:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c196c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.601543:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c196c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.602038:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1973 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.602054:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1926 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a168 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.602363:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1973 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.602579:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1926 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a168 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.602626:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1926 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a168 expref: 15 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726051.602645:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a869500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935093888:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788726051.602762:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a107aa3480 going to sleep for 11 seconds 00000001:00080000:1.0:1788726051.603841:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788726051.603858:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1788726051.606647:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a869500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935093888:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788726051.606690:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1973 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726051.606872:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726051.607032:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914110976 00000100:00100000:2.0:1788726051.607044:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914110976 00010000:00010000:2.0:1788726051.607167:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1926 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a168 expref: 16 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726051.607212:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:2.0:1788726051.607257:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:2350:x1875614914110976:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726051.607282:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726051.607289:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1926 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a168 expref: 16 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.607379:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1926 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a168 expref: 16 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.607415:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1926 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a168 expref: 16 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.607433:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a11214ca00) 00010000:00010000:2.0:1788726051.607438:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1973 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.607449:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.607457:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1973 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.607487:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788726051.607624:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.607633:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788726051.607897:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1788726051.608076:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788726051.608129:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1788726051.608295:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a869500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875614935094016:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788726051.608372:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726051.608415:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a110318600 going to sleep for 11 seconds 00000100:00100000:3.0:1788726051.608583:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935094016 00000100:00100000:3.0:1788726051.608591:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935094016 00000100:00100000:1.0:1788726051.608766:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788726051.608776:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1875614935094016:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788726051.608910:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:2350:x1875614914110976:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 1652us (2036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726051.608920:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:1.0:1788726051.610266:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1875614935094016:12345-0@lo:1000:mdt00_001.0 Request processed in 1483us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726051.610279:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788726051.610900:0:5835:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788726051.610908:0:5835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:2.0:1788726051.610933:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a1116a3b80, transno 4294967309 00000004:00080000:2.0:1788726051.610949:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a1116a0000, transno 4294967310 00000100:00100000:2.0:1788726051.610958:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a869500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875614935094016:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788726051.613020:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788726051.613207:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875614935094144:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788726051.613322:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726051.613368:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1088c5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788726051.613421:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935094144 00000100:00100000:3.0:1788726051.613431:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935094144 00000100:00100000:3.0:1788726051.613497:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788726051.613509:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1875614935094144:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788726051.613758:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1875614935094144:12345-0@lo:1000:mdt00_001.0 Request processed in 250us (434us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788726051.613767:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788726051.613878:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875614935094144:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788726051.613925:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.613937:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1973 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.613946:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1973 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.613953:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726051.613959:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1973 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.613969:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1973 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.613990:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a11214ca00) 00010000:00010000:2.0:1788726051.613994:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788726051.614001:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1973 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.614007:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1973 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.614045:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c18b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.614052:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c18b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.614076:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c18b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.614080:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726051.614082:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c18b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.614086:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c18b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.614092:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:2.0:1788726051.614094:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788726051.614101:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c18bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a14c expref: 18 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.614111:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c18bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a14c expref: 18 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.614118:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c18bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a14c expref: 18 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.614142:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c18bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a14c expref: 18 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726051.614151:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935094272:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788726051.614265:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1088c5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788726051.617987:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726051.618029:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935094272:192.168.201.42@tcp:105: 00010000:00010000:1.0:1788726051.618066:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c18b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618078:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c18b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618148:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c197a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618166:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c197a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618180:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c197a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618192:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c197a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618199:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c197a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618207:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c197a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618260:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726051.618265:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c197a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618274:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c197a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618288:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:1.0:1788726051.618291:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726051.618295:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c197a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618301:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c197a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618321:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c196c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618327:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c196c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618332:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c196c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618337:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726051.618340:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c196c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726051.618345:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914111104 00010000:00010000:1.0:1788726051.618346:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c196c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726051.618354:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914111104 00010000:00010000:1.0:1788726051.618354:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:1.0:1788726051.618357:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788726051.618360:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c196c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.618365:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c196c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726051.618430:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:2.0:1788726051.618441:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:10527:x1875614914111104:12345-192.168.201.42@tcp:49:lfs.0 00000100:00100000:2.0:1788726051.618633:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:10527:x1875614914111104:12345-192.168.201.42@tcp:49:lfs.0 Request processed in 192us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726051.618633:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:10528:x1875614914110848:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 17269us (17463us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788726051.618641:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:1.0:1788726051.618642:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 127 00000020:00080000:1.0:1788726051.618651:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788726051.620025:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788726051.620036:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788726051.620596:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788726051.620607:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788726051.621951:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726051.622013:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914111360 00000100:00100000:3.0:1788726051.622028:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914111360 00000100:00100000:3.0:1788726051.622113:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 128 00000100:00100000:3.0:1788726051.622126:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aefb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:10527:x1875614914111360:12345-192.168.201.42@tcp:58:lfs.0 00000100:00100000:0.0:1788726051.623099:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726051.623187:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914111616 00000100:00100000:1.0:1788726051.623196:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914111616 00000040:00080000:3.0:1788726051.623200:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788726051.623290:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:1.0:1788726051.623299:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111084050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:10528:x1875614914111616:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788726051.623322:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aefb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:10527:x1875614914111360:12345-192.168.201.42@tcp:58:lfs.0 Request processed in 1198us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726051.623330:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 128 00000004:00080000:1.0:1788726051.623999:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788726051.624126:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788726051.624182:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1981 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.624204:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1981 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.624238:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1981 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.624249:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1981 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.624256:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1981 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.624263:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1981 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.624285:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788726051.624367:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111084050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:10528:x1875614914111616:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 1066us (1272us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788726051.624376:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000020:00080000:1.0:1788726051.624381:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788726051.624454:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726051.624461:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1981 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.624479:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726051.624484:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1981 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.624492:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1981 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.624507:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91a10d14d000) 00010000:00010000:1.0:1788726051.624511:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788726051.624517:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1981 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.624523:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1981 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726051.624544:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726051.624546:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726051.624548:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726051.652332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726051.652809:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914111744 00000100:00100000:2.0:1788726051.652824:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914111744 00000100:00100000:2.0:1788726051.653015:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 129 00000100:00100000:2.0:1788726051.653030:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:10530:x1875614914111744:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726051.653134:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726051.653165:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1988 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a184 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.653966:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c198f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.653990:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c198f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.654005:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c198f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.654027:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1996 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.654033:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726051.654040:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.659401:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c199d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.659432:0:7629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a145 expref: 21 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.659455:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c199d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.659605:0:7629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a145 expref: 21 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.659630:0:7629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a145 expref: 21 pid: 7629 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726051.659654:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935094400:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726051.659860:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788726051.663941:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726051.664151:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914112000 00000100:00100000:1.0:1788726051.664165:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914112000 00000100:00100000:1.0:1788726051.664294:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:1.0:1788726051.664320:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:5591:x1875614914112000:12345-192.168.201.42@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788726051.664682:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:5591:x1875614914112000:12345-192.168.201.42@tcp:35:ldlm_bl.0 Request processed in 376us (757us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788726051.664692:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:0.0:1788726051.664981:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935094400:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726051.665020:0:7629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c199d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726051.673673:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726051.673786:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914112128 00000100:00100000:3.0:1788726051.673811:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914112128 00010000:00010000:3.0:1788726051.673874:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a145 expref: 23 pid: 7629 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726051.673933:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:3.0:1788726051.673945:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aefad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:2349:x1875614914112128:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726051.673964:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726051.673972:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a145 expref: 23 pid: 7629 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.673987:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a145 expref: 23 pid: 7629 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.674042:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c18a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a145 expref: 23 pid: 7629 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.674073:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:3.0:1788726051.674080:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c199d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.674091:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c199d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.674098:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c199d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726051.674134:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726051.674200:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aefad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:2349:x1875614914112128:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 257us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726051.674209:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 60 00010000:00010000:0.0:1788726051.675805:0:7629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c199d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.675827:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c199d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726051.675925:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788726051.675931:0:7629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788726051.675957:0:7629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c199d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.675977:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c199d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.675989:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c198f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.675996:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c198f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.676003:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c198f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.676009:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726051.676014:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c198f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.676022:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c198f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.676041:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726051.676045:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726051.676050:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c198f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.676057:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c198f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.676090:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.676096:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1996 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.676102:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.676107:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eba00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726051.676111:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.676117:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1996 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.676126:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91a11214ca00) 00010000:00010000:0.0:1788726051.676129:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726051.676133:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1996 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.676138:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1996 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.676188:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1988 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a184 expref: 22 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.676206:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c199d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a184 expref: 21 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726051.676265:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:0.0:1788726051.676268:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788726051.676270:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915a00, rc 0) 00000100:00100000:0.0:1788726051.676362:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:10530:x1875614914111744:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 23334us (24056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726051.676377:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 129 00010000:00010000:2.0:1788726051.868237:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788726052.633660:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788726052.633676:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788726052.633728:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788726052.633736:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788726052.633922:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875614935094528:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788726052.634182:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1088c5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788726052.641324:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875614935094528:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788726052.659975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726052.660040:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914112256 00000100:00100000:1.0:1788726052.660074:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914112256 00000100:00100000:1.0:1788726052.660154:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:1.0:1788726052.660168:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a86a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:10541:x1875614914112256:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788726052.660244:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788726052.660413:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a86a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:10541:x1875614914112256:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 247us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726052.660421:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 130 00000100:00100000:0.0:1788726052.669257:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726052.669422:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914112512 00000100:00100000:1.0:1788726052.669437:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914112512 00000100:00100000:1.0:1788726052.669525:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:1.0:1788726052.669537:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aefa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:10541:x1875614914112512:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788726052.669567:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726052.669595:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c19a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a18b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.669743:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c19ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.669763:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c19ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.669780:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c19ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726052.669795:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788726052.669971:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c19a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a18b expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.669990:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c19ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a18b expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.670008:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:1.0:1788726052.670011:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788726052.670017:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921000, rc 0) 00000100:00100000:1.0:1788726052.670344:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aefa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:10541:x1875614914112512:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 807us (1124us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788726052.670354:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 131 00000100:00100000:1.0:1788726052.675041:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726052.675156:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914112640 00000100:00100000:0.0:1788726052.675171:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914112640 00000100:00100000:0.0:1788726052.675315:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:0.0:1788726052.675329:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1128e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:2352:x1875614914112640:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726052.675351:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726052.675401:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c19ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a18b expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726052.675425:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:0.0:1788726052.675431:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726052.675504:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1128e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:2352:x1875614914112640:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 178us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726052.675511:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:0.0:1788726052.675679:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726052.676059:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914112896 00000100:00100000:1.0:1788726052.676066:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914112896 00000100:00100000:1.0:1788726052.676116:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 132 00000100:00100000:1.0:1788726052.676125:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:10541:x1875614914112896:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788726052.676252:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.676271:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.676283:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.676561:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.676570:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.676577:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.676600:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726052.676606:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.676614:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.676631:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:1.0:1788726052.676634:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788726052.676639:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.676646:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726052.676819:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:10541:x1875614914112896:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 694us (1138us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788726052.676828:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 132 00000040:00080000:1.0:1788726052.676973:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788726052.676978:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788726052.679267:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788726052.679292:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788726052.682240:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726052.682764:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914113152 00000100:00100000:1.0:1788726052.682778:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914113152 00000100:00100000:1.0:1788726052.682867:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:1.0:1788726052.682881:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aefad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:10541:x1875614914113152:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788726052.684402:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aefad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:10541:x1875614914113152:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 1512us (2182us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788726052.684431:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000040:00080000:3.0:1788726052.719581:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788726052.719596:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788726052.719652:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788726052.719659:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788726052.886342:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726052.917788:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726052.917881:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914113408 00000100:00100000:3.0:1788726052.917896:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914113408 00000100:00100000:3.0:1788726052.917985:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:3.0:1788726052.917997:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:10554:x1875614914113408:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726052.918036:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726052.918075:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c19c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a192 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726052.918287:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914000/0xcbde9110e47c19c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726052.918307:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914000/0xcbde9110e47c19c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726052.918322:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914000/0xcbde9110e47c19c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726052.918335:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788726052.918725:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c19c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a192 expref: 27 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726052.918751:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914000/0xcbde9110e47c19c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a192 expref: 26 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726052.918762:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:3.0:1788726052.918766:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788726052.918770:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914000, rc 0) 00000100:00100000:3.0:1788726052.918861:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:10554:x1875614914113408:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 865us (1088us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788726052.918870:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 133 00000100:00100000:3.0:1788726052.922733:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726052.923012:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914113536 00000100:00100000:1.0:1788726052.923026:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914113536 00000100:00100000:1.0:1788726052.923117:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:1.0:1788726052.923131:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:10554:x1875614914113536:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:1.0:1788726052.923258:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.923280:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.923293:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.923328:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.923336:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.923344:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.923350:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726052.923356:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.923363:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.923405:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:1.0:1788726052.923408:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788726052.923415:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726052.923422:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921600/0xcbde9110e47c19d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726052.923519:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:10554:x1875614914113536:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 391us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726052.923528:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:0.0:1788726053.060516:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726053.060627:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914113664 00000100:00100000:1.0:1788726053.060642:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914113664 00000100:00100000:1.0:1788726053.060747:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:1.0:1788726053.060761:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914113664:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:1.0:1788726053.060789:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726053.060816:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bf51c36/0xcbde9110e47c19dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a199 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788726053.060852:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9dcb22, atime: 0x6a9dcb22, ctime: 0x6a9dcb22, blocks: 0xb 00010000:00010000:1.0:1788726053.060880:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:1.0:1788726053.060885:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726053.060896:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bf51c36/0xcbde9110e47c19dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a199 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726053.060918:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008bf51c36/0xcbde9110e47c19dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a199 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726053.060960:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921600, rc 0) 00000100:00100000:1.0:1788726053.061043:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914113664:12345-192.168.201.42@tcp:101:cat.0 Request processed in 285us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726053.061051:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00080000:0.0:1788726053.061676:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788726053.078859:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726053.079037:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914113792 00000100:00100000:2.0:1788726053.079052:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914113792 00002000:00100000:2.0:1788726053.079120:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff91a13a86b480 x1875614914113792/t0(0) o3->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:449/0 lens 488/0 e 0 to 0 dl 1788726064 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788726053.079134:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13a86b480 with x1875614914113792 ext(0->4095) 00002000:00010000:2.0:1788726053.079141:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a13a86b480 00000100:00100000:2.0:1788726053.079183:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:2.0:1788726053.079195:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914113792:12345-192.168.201.42@tcp:3:cat.0 00000100:00100000:2.0:1788726053.079563:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914113792:12345-192.168.201.42@tcp:3:cat.0 Request processed in 365us (716us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788726053.079581:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00002000:00100000:2.0:1788726053.079591:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff91a13a86b480 x1875614914113792/t0(0) o3->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:449/0 lens 488/4536 e 0 to 0 dl 1788726064 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788726053.079599:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13a86b480 with x1875614914113792 ext(0->4095) 00002000:00010000:2.0:1788726053.079603:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a13a86b480 00010000:00010000:1.0:1788726053.911827:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726054.840621:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726054.840675:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726054.840704:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914113920 00000100:00100000:1.0:1788726054.840717:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726054.840720:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914113920 00000100:00100000:1.0:1788726054.840749:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726054.840783:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726054.840805:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 287 00000100:00100000:1.0:1788726054.840814:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914114432 00000100:00100000:1.0:1788726054.840820:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914114432 00000100:00100000:0.0:1788726054.840820:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2349:x1875614914113920:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726054.840873:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914114048 00000100:00100000:1.0:1788726054.840877:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914114048 00000100:00100000:1.0:1788726054.840905:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:1.0:1788726054.840913:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a86b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2349:x1875614914114432:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726054.840925:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2349:x1875614914113920:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 109us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726054.840935:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 287 00000100:00100000:1.0:1788726054.840956:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a86b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2349:x1875614914114432:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 44us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726054.840966:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 134 00000100:00100000:1.0:1788726054.840980:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:1.0:1788726054.840986:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:2349:x1875614914114048:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726054.841010:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:2349:x1875614914114048:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726054.841036:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:1.0:1788726054.841063:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914114176 00000100:00100000:1.0:1788726054.841067:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914114176 00000100:00100000:1.0:1788726054.841095:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914114304 00000100:00100000:1.0:1788726054.841098:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914114304 00000100:00100000:1.0:1788726054.841120:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:1.0:1788726054.841127:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2349:x1875614914114176:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726054.841158:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2349:x1875614914114176:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 31us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726054.841164:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:1.0:1788726054.841175:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:1.0:1788726054.841182:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a86b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914114304:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726054.841210:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a86b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914114304:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726054.841245:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00080000:1.0:1788726054.841263:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788726054.841269:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788726054.933445:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726055.137906:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935094656:0@lo:400:kworker.0 00000100:00100000:0.0:1788726055.138016:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726055.138081:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935095168:0@lo:400:kworker.0 00000100:00100000:0.0:1788726055.138112:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726055.138145:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788726055.138153:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935095040:0@lo:400:kworker.0 00000100:00100000:0.0:1788726055.138178:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726055.138230:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935094784:0@lo:400:kworker.0 00000100:00100000:0.0:1788726055.138258:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726055.138279:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935095296:0@lo:400:kworker.0 00000100:00100000:0.0:1788726055.138307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726055.138339:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788726055.138346:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935094912:0@lo:400:kworker.0 00000100:00100000:0.0:1788726055.138369:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726055.138410:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935094656 00000100:00100000:0.0:1788726055.138420:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935094656 00000100:00100000:0.0:1788726055.138479:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788726055.138491:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935094656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726055.138578:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935094656:12345-0@lo:400:kworker.0 Request processed in 88us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726055.138587:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788726055.138627:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935095168 00000100:00100000:0.0:1788726055.138631:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935095168 00000100:00100000:0.0:1788726055.138669:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935095040 00000100:00100000:0.0:1788726055.138672:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935095040 00000100:00100000:0.0:1788726055.138688:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935094784 00000100:00100000:0.0:1788726055.138691:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935094784 00000100:00100000:0.0:1788726055.138706:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788726055.138713:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935095168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726055.140710:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935095168:12345-0@lo:400:kworker.0 Request processed in 1985us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726055.140730:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788726055.140788:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788726055.140806:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935095040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726055.140870:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935095040:12345-0@lo:400:kworker.0 Request processed in 74us (2691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726055.140877:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788726055.140889:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788726055.140896:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935094784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726055.140932:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935094784:12345-0@lo:400:kworker.0 Request processed in 37us (2673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726055.140938:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788726055.140982:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935095296 00000100:00100000:0.0:1788726055.140990:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935095296 00000100:00100000:0.0:1788726055.141038:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935094912 00000100:00100000:0.0:1788726055.141059:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935094912 00000100:00100000:0.0:1788726055.141087:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788726055.141093:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875614935095296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726055.141130:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875614935095296:12345-0@lo:400:kworker.0 Request processed in 37us (2822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726055.141136:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788726055.141147:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788726055.141153:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935094912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726055.141721:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935094784:0@lo:400:kworker.0 00000100:00100000:1.0:1788726055.141748:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935095296:0@lo:400:kworker.0 00000100:00100000:0.0:1788726055.142026:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935094912:12345-0@lo:400:kworker.0 Request processed in 870us (3653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726055.142034:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788726055.142070:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788726055.142075:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788726055.142079:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726055.142120:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935095040:0@lo:400:kworker.0 00000100:00100000:0.0:1788726055.142133:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935094656:0@lo:400:kworker.0 00000100:00100000:0.0:1788726055.142145:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935095168:0@lo:400:kworker.0 00000100:00100000:1.0:1788726055.144099:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788726055.144111:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1788726055.144136:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a13b027800, transno 4294967301 00000004:00080000:1.0:1788726055.144155:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1788726055.144178:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a13aef9c00, transno 4294967304 00000100:00100000:1.0:1788726055.144189:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935094912:0@lo:400:kworker.0 00000100:00100000:1.0:1788726055.637699:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788726055.637746:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13aef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935095424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788726055.637850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726055.638270:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935095424 00000100:00100000:0.0:1788726055.638283:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935095424 00000100:00100000:0.0:1788726055.638362:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788726055.638375:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875614935095424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788726055.638428:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726055.638501:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875614935095424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726055.638510:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788726055.638737:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13aef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935095424:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788726055.958434:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726056.661901:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13aef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935095552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788726056.662009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726056.666415:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935095552 00000100:00100000:0.0:1788726056.666438:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935095552 00000100:00100000:0.0:1788726056.666515:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788726056.666530:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935095552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788726056.666583:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726056.666684:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935095552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (4674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726056.666692:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788726056.670336:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13aef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935095552:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788726056.735270:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1788726056.735291:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1788726056.755856:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:0.0:1788726056.755897:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788726056.755916:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a1088c5000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788726056.755923:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a12ae2bf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a1088c5c00 00000020:00080000:0.0:1788726056.755927:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a12ae2b100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a1033b0400 00000001:00080000:0.0:1788726056.755937:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1788726056.756105:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788726056.756746:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1788726056.981859:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726058.007472:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726058.754815:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726058.754964:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914114560 00000100:00100000:0.0:1788726058.754979:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914114560 00000100:00100000:0.0:1788726058.755089:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00100000:0.0:1788726058.755103:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a86ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:10216:x1875614914114560:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788726058.755300:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a86ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:10216:x1875614914114560:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 199us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726058.755309:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 135 00000100:00080000:1.0:1788726058.755791:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726058.758061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726058.758287:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914114816 00000100:00100000:2.0:1788726058.758301:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914114816 00000100:00100000:2.0:1788726058.758378:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:2.0:1788726058.758392:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a86a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:10216:x1875614914114816:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788726058.759131:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a86a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:10216:x1875614914114816:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 737us (1080us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788726058.759143:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00000040:00080000:2.0:1788726058.837908:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788726058.837920:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788726058.837960:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788726058.837966:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788726059.035054:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726059.076825:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726059.077451:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914114944 00000100:00100000:0.0:1788726059.077497:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914114944 00000100:00100000:0.0:1788726059.077611:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00100000:0.0:1788726059.077626:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:11009:x1875614914114944:12345-192.168.201.42@tcp:101:lsof.0 00010000:00010000:0.0:1788726059.077658:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726059.077685:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c19e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a1a0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726059.077776:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c19ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726059.077792:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c19ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726059.077807:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c19ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726059.077857:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788726059.078434:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788726059.078509:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c19ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726059.078545:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c19e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1a0 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726059.078568:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c19ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1a0 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726059.078577:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639200) 00010000:00010000:0.0:1788726059.078580:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788726059.078584:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725200, rc 0) 00000100:00100000:0.0:1788726059.078689:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:11009:x1875614914114944:12345-192.168.201.42@tcp:101:lsof.0 Request processed in 1066us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726059.078699:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 136 00000100:00080000:1.0:1788726059.079494:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726059.947729:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726059.947790:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726059.947942:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914115200 00000100:00100000:2.0:1788726059.947957:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914115200 00000100:00100000:2.0:1788726059.948044:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:2.0:1788726059.948057:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:2351:x1875614914115200:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788726059.948185:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:2351:x1875614914115200:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 131us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726059.948194:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:0.0:1788726059.948886:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726059.948926:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726059.948970:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914115072 00000100:00100000:3.0:1788726059.948978:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914115072 00000100:00100000:3.0:1788726059.949028:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 289 00000100:00100000:3.0:1788726059.949057:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2351:x1875614914115072:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726059.949123:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2351:x1875614914115072:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 59us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726059.949130:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 289 00000100:00100000:0.0:1788726059.954554:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726059.954766:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914115584 00000100:00100000:3.0:1788726059.954778:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914115584 00000100:00100000:3.0:1788726059.954867:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:3.0:1788726059.954880:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:2351:x1875614914115584:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726059.954985:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:2351:x1875614914115584:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 107us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726059.954992:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:1.0:1788726059.957094:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914115456 00000100:00100000:1.0:1788726059.957121:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914115456 00000100:00100000:1.0:1788726059.957261:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914115328 00000100:00100000:1.0:1788726059.957266:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914115328 00000100:00100000:1.0:1788726059.957308:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:3.0:1788726059.957986:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:3.0:1788726059.958002:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914115328:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726059.958114:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914115328:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 118us (9186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726059.958122:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00080000:0.0:1788726059.959474:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788726059.959487:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788726059.959575:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2351:x1875614914115456:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726059.959679:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2351:x1875614914115456:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 2359us (11885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726059.959690:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 81 00010000:00010000:2.0:1788726060.053847:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726060.247875:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935096064:0@lo:400:kworker.0 00000100:00100000:1.0:1788726060.247983:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726060.248098:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788726060.248107:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935095680:0@lo:400:kworker.0 00000100:00100000:1.0:1788726060.248144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726060.248189:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935096192:0@lo:400:kworker.0 00000100:00100000:1.0:1788726060.248265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726060.248306:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935095680 00000100:00100000:1.0:1788726060.248315:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935095680 00000100:00100000:1.0:1788726060.248376:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788726060.248386:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935095680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726060.248446:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935095680:12345-0@lo:400:kworker.0 Request processed in 61us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726060.248454:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788726060.248499:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935096064 00000100:00100000:1.0:1788726060.248503:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935096064 00000100:00100000:1.0:1788726060.248540:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935096192 00000100:00100000:1.0:1788726060.248542:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935096192 00000100:00100000:1.0:1788726060.248564:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788726060.248570:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a86bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935096064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726060.248606:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a86bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935096064:12345-0@lo:400:kworker.0 Request processed in 36us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726060.248612:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788726060.248624:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788726060.248630:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935096192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726060.248655:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935096192:12345-0@lo:400:kworker.0 Request processed in 25us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726060.248660:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1788726060.248677:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726060.248714:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935095680:0@lo:400:kworker.0 00000100:00100000:1.0:1788726060.248730:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935096192:0@lo:400:kworker.0 00000100:00100000:1.0:1788726060.248756:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935096064:0@lo:400:kworker.0 00000100:00100000:3.0:1788726060.248931:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935095808:0@lo:400:kworker.0 00000100:00100000:3.0:1788726060.248973:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726060.249012:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935096320:0@lo:400:kworker.0 00000100:00100000:3.0:1788726060.249040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726060.249061:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788726060.249067:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935095936:0@lo:400:kworker.0 00000100:00100000:3.0:1788726060.249087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726060.249114:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935096320 00000100:00100000:3.0:1788726060.249125:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935096320 00000100:00100000:3.0:1788726060.249164:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935095936 00000100:00100000:3.0:1788726060.249168:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935095936 00000100:00100000:3.0:1788726060.249194:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788726060.249204:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935096320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726060.249251:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788726060.249265:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935095936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726060.249297:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935096320:12345-0@lo:400:kworker.0 Request processed in 95us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726060.249306:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788726060.249324:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935095936:12345-0@lo:400:kworker.0 Request processed in 62us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726060.249340:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788726060.249346:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935095936:0@lo:400:kworker.0 00000100:00100000:3.0:1788726060.249360:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788726060.249366:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788726060.249386:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935096320:0@lo:400:kworker.0 00000100:00100000:0.0:1788726060.249639:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935095808 00000100:00100000:0.0:1788726060.249645:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935095808 00000100:00100000:0.0:1788726060.249690:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788726060.249698:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935095808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726060.249753:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935095808:12345-0@lo:400:kworker.0 Request processed in 56us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726060.249760:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788726060.249841:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935095808:0@lo:400:kworker.0 00000100:00080000:1.0:1788726060.253726:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788726060.253742:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788726060.758901:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788726060.759919:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935096448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788726060.760026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726060.760857:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935096448 00000100:00100000:0.0:1788726060.760871:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935096448 00000100:00100000:0.0:1788726060.760990:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788726060.761003:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935096448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788726060.761057:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726060.761142:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935096448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726060.761150:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788726060.761284:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935096448:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788726061.079558:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726061.781827:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935096576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788726061.781936:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726061.782037:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935096576 00000100:00100000:1.0:1788726061.782049:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935096576 00000100:00100000:1.0:1788726061.782114:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788726061.782137:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a86aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935096576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788726061.782188:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788726061.782280:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a86aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935096576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726061.782288:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788726061.782363:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935096576:0@lo:13:osp-pre-0-0.0 00000020:00080000:0.0:1788726061.857992:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1788726061.858033:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788726061.859395:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788726061.859416:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788726062.101593:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788726062.817648:0:12249:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:21:01 (1788726061) 00010000:00010000:2.0:1788726063.126147:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726064.149681:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726064.265638:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726064.265906:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914115840 00000100:00100000:1.0:1788726064.265916:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914115840 00000100:00100000:1.0:1788726064.266001:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:1.0:1788726064.266022:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:11274:x1875614914115840:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788726064.266044:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726064.266067:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c19f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a1a7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.266206:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c19f8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.266255:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c19f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.266269:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c19f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.266285:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c19ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.266292:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c19ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.266300:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c19ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.266803:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1a06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.266813:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1a06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.266822:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1a06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726064.266832:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788726064.266984:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c19f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.266992:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c19f8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.267004:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c19f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.267010:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920800 already unused, calling callback (ffffffffc1e4a4f0) 00000100:00080000:2.0:1788726064.268863:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788726064.268928:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c19f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.268941:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c19f8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.268960:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91a11214c200) 00010000:00010000:1.0:1788726064.268964:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726064.268969:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c19f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.268977:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c19f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.268995:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c19ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.269001:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c19ff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.269007:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c19ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.269070:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726064.269074:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c19ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.269100:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c19ff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.269109:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91a10d14dd00) 00010000:00010000:1.0:1788726064.269111:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726064.269114:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c19ff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.269121:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c19ff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.270194:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c19f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1a7 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.270244:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1a06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1a7 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726064.270254:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:1.0:1788726064.270257:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726064.270259:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920a00, rc 0) 00000100:00100000:1.0:1788726064.270337:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:11274:x1875614914115840:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 4326us (4709us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788726064.270347:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 137 00000100:00100000:0.0:1788726064.275057:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726064.275150:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914115968 00000100:00100000:1.0:1788726064.275161:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914115968 00000100:00100000:1.0:1788726064.275270:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:1.0:1788726064.275280:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:11274:x1875614914115968:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788726064.275398:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:11274:x1875614914115968:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 120us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726064.275405:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 138 00000100:00100000:3.0:1788726064.276565:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726064.276643:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914116096 00000100:00100000:0.0:1788726064.276654:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914116096 00000100:00100000:0.0:1788726064.276720:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:0.0:1788726064.276728:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a610a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:2352:x1875614914116096:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726064.276741:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726064.276764:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1a06 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1a7 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726064.276783:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:0.0:1788726064.276788:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726064.276840:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a610a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:2352:x1875614914116096:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 113us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726064.276853:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000040:00080000:2.0:1788726064.982511:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788726064.982527:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788726064.982573:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788726064.982581:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788726065.067597:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726065.067651:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726065.067682:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726065.067719:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726065.067758:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914116480 00000100:00100000:0.0:1788726065.067770:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914116480 00000100:00100000:0.0:1788726065.067843:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914116352 00000100:00100000:0.0:1788726065.067846:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914116352 00000100:00100000:0.0:1788726065.067875:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:0.0:1788726065.067885:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2352:x1875614914116480:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726065.067980:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2352:x1875614914116480:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 96us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726065.068006:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:0.0:1788726065.068024:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:0.0:1788726065.068031:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2352:x1875614914116352:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726065.068065:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2352:x1875614914116352:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 35us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726065.068071:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:0.0:1788726065.068091:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914116608 00000100:00100000:0.0:1788726065.068094:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914116608 00000100:00100000:0.0:1788726065.068129:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:0.0:1788726065.068135:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:2352:x1875614914116608:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726065.068179:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:2352:x1875614914116608:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 45us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726065.068186:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00080000:0.0:1788726065.068203:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788726065.068209:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788726065.068211:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788726065.069133:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914116224 00000100:00100000:1.0:1788726065.069143:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914116224 00000100:00100000:1.0:1788726065.069199:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 291 00000100:00100000:1.0:1788726065.069209:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:2352:x1875614914116224:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726065.069291:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+13:2352:x1875614914116224:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 84us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726065.069298:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 291 00010000:00010000:2.0:1788726065.175246:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726065.371738:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935096704:0@lo:400:kworker.0 00000100:00100000:0.0:1788726065.371814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726065.371888:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935096704 00000100:00100000:0.0:1788726065.371896:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935096704 00000100:00100000:0.0:1788726065.371953:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788726065.371963:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935096704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726065.372017:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935096704:12345-0@lo:400:kworker.0 Request processed in 56us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726065.372024:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788726065.372081:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935096704:0@lo:400:kworker.0 00000100:00100000:2.0:1788726065.372272:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935097088:0@lo:400:kworker.0 00000100:00100000:2.0:1788726065.372306:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726065.372332:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788726065.372338:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935097216:0@lo:400:kworker.0 00000100:00100000:2.0:1788726065.372359:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726065.372524:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935096960:0@lo:400:kworker.0 00000100:00100000:2.0:1788726065.372549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726065.372564:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788726065.372568:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935096832:0@lo:400:kworker.0 00000100:00100000:2.0:1788726065.372584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726065.372595:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935097344:0@lo:400:kworker.0 00000100:00100000:2.0:1788726065.372612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726065.372646:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935097088 00000100:00100000:2.0:1788726065.372651:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935097088 00000100:00100000:2.0:1788726065.372687:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935097216 00000100:00100000:2.0:1788726065.372690:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935097216 00000100:00100000:2.0:1788726065.372703:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935096832 00000100:00100000:2.0:1788726065.372705:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935096832 00000100:00100000:2.0:1788726065.372716:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788726065.372721:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935097088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726065.372765:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935097088:12345-0@lo:400:kworker.0 Request processed in 44us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726065.372772:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788726065.372785:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788726065.372791:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935097216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726065.372816:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935097216:12345-0@lo:400:kworker.0 Request processed in 26us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726065.372822:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788726065.372833:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788726065.372839:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935096832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726065.372869:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935096832:12345-0@lo:400:kworker.0 Request processed in 30us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726065.372875:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788726065.372918:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935096832:0@lo:400:kworker.0 00000100:00100000:2.0:1788726065.372944:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935097216:0@lo:400:kworker.0 00000100:00100000:2.0:1788726065.372954:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935097088:0@lo:400:kworker.0 00000100:00100000:0.0:1788726065.374379:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935096960 00000100:00100000:0.0:1788726065.374391:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935096960 00000100:00100000:0.0:1788726065.374452:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935097344 00000100:00100000:0.0:1788726065.374456:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935097344 00000100:00100000:0.0:1788726065.374486:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788726065.374495:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935096960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726065.374568:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935096960:12345-0@lo:400:kworker.0 Request processed in 75us (2017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726065.374574:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788726065.374584:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788726065.374590:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935097344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726065.374632:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935097344:12345-0@lo:400:kworker.0 Request processed in 29us (2005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726065.374639:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788726065.374659:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788726065.374662:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788726065.374664:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726065.374696:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935097344:0@lo:400:kworker.0 00000100:00100000:0.0:1788726065.374709:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935096960:0@lo:400:kworker.0 00000100:00100000:3.0:1788726065.888883:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788726065.888909:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935097472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788726065.888985:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726065.889178:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935097472 00000100:00100000:0.0:1788726065.889187:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935097472 00000100:00100000:0.0:1788726065.889269:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788726065.889279:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935097472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788726065.889317:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726065.889382:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935097472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726065.889403:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788726065.889452:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935097472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788726066.199541:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726066.304873:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726066.304994:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914116736 00000100:00100000:1.0:1788726066.305006:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914116736 00000100:00080000:0.0:1788726066.305157:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726066.305212:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:1.0:1788726066.305256:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:11317:x1875614914116736:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788726066.305280:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726066.305304:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a1ae expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305390:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305405:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305416:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305447:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305455:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305462:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305655:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305663:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305671:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305677:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726066.305682:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305689:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305704:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639200) 00010000:00010000:1.0:1788726066.305707:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726066.305711:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305716:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305735:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305742:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305748:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305753:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726066.305756:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305762:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305770:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91a10d14dd00) 00010000:00010000:1.0:1788726066.305772:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726066.305774:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305779:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305809:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1ae expref: 15 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305820:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639200) 00010000:00010000:1.0:1788726066.305822:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726066.305832:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1ae expref: 15 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.305840:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920e00, rc 0) 00000100:00100000:1.0:1788726066.305899:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:11317:x1875614914116736:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 646us (1036us total) trans 0 rc 301/301 00000100:00100000:1.0:1788726066.305906:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 139 00000100:00100000:1.0:1788726066.319166:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726066.319287:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914116992 00000100:00100000:3.0:1788726066.319299:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914116992 00000100:00100000:3.0:1788726066.319367:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 140 00000100:00100000:3.0:1788726066.319377:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:11317:x1875614914116992:12345-192.168.201.42@tcp:36:lfs.0 00010000:00010000:3.0:1788726066.319463:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726066.319499:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10149a200/0xcbde9110e47c1392 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fe7 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.319522:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639200) 00010000:00010000:3.0:1788726066.319527:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788726066.319767:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1a29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.319782:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c19ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1a0 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.319790:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1a29 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.319826:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c19ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1a0 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.319841:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c19ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1a0 expref: 5 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726066.319857:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139867800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935097600:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726066.319955:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1338e2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788726066.325332:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726066.326320:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914117120 00000100:00100000:3.0:1788726066.326332:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914117120 00010000:00010000:3.0:1788726066.326392:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c19ea lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1a0 expref: 6 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726066.326450:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:3.0:1788726066.326467:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:2350:x1875614914117120:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726066.326482:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726066.326489:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c19ea lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1a0 expref: 6 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.326502:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c19ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1a0 expref: 6 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.326525:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639200) 00010000:00010000:3.0:1788726066.326530:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1a29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.326539:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1a29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.326545:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1a29 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.326564:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726066.326618:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:2350:x1875614914117120:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 152us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726066.326625:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00010000:00010000:1.0:1788726066.329544:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c19ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1a0 expref: 5 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726066.329570:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139867800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935097600:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788726066.329594:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1a29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.329604:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1a29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.329610:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1a29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.329637:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a30 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.329650:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.329661:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726066.331822:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788726066.331839:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1a29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.331847:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1a29 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.331852:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1a29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.331856:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726066.331859:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1a29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.331865:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1a29 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.331877:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a111639200) 00010000:00010000:1.0:1788726066.331879:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726066.331882:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1a29 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.331885:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1a29 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788726066.331899:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f0a686e reply state 000000006ed55b5a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726066.331905:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788726066.332030:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:11317:x1875614914116992:12345-192.168.201.42@tcp:36:lfs.0 Request processed in 12653us (12871us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788726066.332044:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 140 00010000:00010000:0.0:1788726066.339530:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.339550:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a30 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.339559:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.339566:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726066.339570:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.339578:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a30 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.339596:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91a10d14dd00) 00010000:00010000:0.0:1788726066.339599:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726066.339604:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a30 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.339610:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a30 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726066.441728:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726066.441811:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914117248 00000100:00100000:1.0:1788726066.441823:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914117248 00000100:00100000:1.0:1788726066.441884:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 141 00000100:00100000:1.0:1788726066.441895:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:11325:x1875614914117248:12345-192.168.201.42@tcp:101:lctl.0 00010000:00010000:1.0:1788726066.441920:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726066.441944:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a1b5 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.442010:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.442024:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.442036:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726066.442080:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788726066.442083:0:7629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788726066.442101:0:7629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.442120:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1b5 expref: 16 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.442134:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1b5 expref: 15 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.442169:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d500) 00010000:00010000:1.0:1788726066.442172:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788726066.442176:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920600, rc 0) 00000100:00100000:1.0:1788726066.442267:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:11325:x1875614914117248:12345-192.168.201.42@tcp:101:lctl.0 Request processed in 374us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726066.442272:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 141 00000100:00100000:2.0:1788726066.519940:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726066.520022:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914117376 00000100:00100000:1.0:1788726066.520031:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914117376 00000100:00100000:1.0:1788726066.520086:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 142 00000100:00100000:1.0:1788726066.520095:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+15:11331:x1875614914117376:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788726066.520115:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726066.520162:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a1bc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520270:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1a4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520282:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1a4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520290:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1a4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520301:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1a53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520308:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520333:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520445:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1a5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520454:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520461:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726066.520488:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788726066.520492:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788726066.520509:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520521:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1a4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520528:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1a4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520535:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1a4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520541:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726066.520545:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1a4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520553:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1a4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520572:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d500) 00010000:00010000:1.0:1788726066.520575:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726066.520580:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1a4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520587:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c1a4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520602:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520608:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1a53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520615:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1a53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520621:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726066.520624:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1a53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520630:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1a53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520637:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91a10d14da00) 00010000:00010000:1.0:1788726066.520640:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726066.520642:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1a53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520648:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920000/0xcbde9110e47c1a53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520690:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1bc expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520703:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1a5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1bc expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.520710:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:1.0:1788726066.520712:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788726066.520715:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920a00, rc 0) 00000100:00100000:1.0:1788726066.520785:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:11331:x1875614914117376:12345-192.168.201.42@tcp:101:bash.0 Request processed in 690us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726066.520793:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 142 00000100:00100000:2.0:1788726066.525651:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726066.525714:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914117632 00000100:00100000:1.0:1788726066.525722:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914117632 00000100:00100000:1.0:1788726066.525770:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 143 00000100:00100000:1.0:1788726066.525777:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:11331:x1875614914117632:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788726066.525795:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726066.525819:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921c00/0xcbde9110e47c1a61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a1c3 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.525926:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.525938:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.525946:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.526015:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1a6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.526020:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1a6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.526025:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1a6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788726066.526893:0:7629:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788726066.527295:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.527308:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.527317:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.527430:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.527439:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.527446:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.527452:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726066.527457:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.527478:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.527490:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:1.0:1788726066.527493:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726066.527498:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.527505:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1a68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788726066.527521:0:7629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b658307b reply state 0000000040584131 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1a6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726066.527530:0:7629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788726066.527565:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921c00/0xcbde9110e47c1a61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1c3 expref: 19 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.527579:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1c3 expref: 18 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.527586:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a10d14da00) 00010000:00010000:1.0:1788726066.527588:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788726066.527591:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920800, rc 0) 00000100:00100000:1.0:1788726066.527771:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:11331:x1875614914117632:12345-192.168.201.42@tcp:101:bash.0 Request processed in 1991us (2129us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788726066.527780:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 143 00010000:00010000:3.0:1788726066.534209:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1a6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.534261:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1a6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.534269:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1a6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.534294:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726066.534301:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1a6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.534311:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1a6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.534409:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a10d14d400) 00010000:00010000:3.0:1788726066.534413:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726066.534419:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1a6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.534425:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1a6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726066.542346:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726066.542436:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914117760 00000100:00100000:0.0:1788726066.542446:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914117760 00000100:00100000:0.0:1788726066.542514:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:0.0:1788726066.542523:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2352:x1875614914117760:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788726066.542541:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726066.542560:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1a84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a1ca expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726066.542585:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726066.542601:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1788726066.542606:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726066.542615:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1a84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1ca expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.542633:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1a84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1ca expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.542646:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725400, rc 0) 00000100:00100000:0.0:1788726066.542700:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2352:x1875614914117760:12345-192.168.201.42@tcp:101:bash.0 Request processed in 178us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726066.542707:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:2.0:1788726066.552287:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726066.552437:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914117888 00000100:00100000:0.0:1788726066.552448:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914117888 00000100:00100000:0.0:1788726066.552505:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:0.0:1788726066.552514:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:11331:x1875614914117888:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788726066.552529:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726066.552544:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c1a8b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a1d1 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.552588:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1a84 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1ca expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.552594:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726066.552598:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726066.552603:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c1a8b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1d1 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.552638:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1a84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1ca expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.552653:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1a84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1ca expref: 7 pid: 6682 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726066.552668:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1875614935097728:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726066.553162:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13aed0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788726066.566987:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726066.567094:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914118016 00000100:00100000:2.0:1788726066.567104:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914118016 00010000:00010000:2.0:1788726066.567155:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1a84 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1ca expref: 8 pid: 6682 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726066.567253:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:2.0:1788726066.567264:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a869500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2349:x1875614914118016:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726066.567278:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726066.567305:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1a84 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1ca expref: 8 pid: 6682 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.567319:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1a84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1ca expref: 8 pid: 6682 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.567343:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726066.567347:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726066.567355:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c1a8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1d1 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.567364:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c1a8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1d1 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.567399:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c1a8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1d1 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726066.567414:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875614935097856:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788726066.567486:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a139cde540 going to sleep for 11 seconds 00010000:00010000:0.0:1788726066.570070:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1a84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1ca expref: 8 pid: 6682 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726066.570094:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1875614935097728:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726066.570123:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c1a8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1d1 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.570146:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725000, rc 0) 00000100:00100000:0.0:1788726066.570280:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:11331:x1875614914117888:12345-192.168.201.42@tcp:101:bash.0 Request processed in 17766us (18002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726066.570288:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:3.0:1788726066.570827:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875614935097856:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788726066.570840:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726066.570879:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a869500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914118016:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 3617us (3903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726066.570888:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:1.0:1788726066.580432:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726066.580559:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914118272 00000100:00100000:2.0:1788726066.580570:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914118272 00000100:00100000:2.0:1788726066.580638:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:2.0:1788726066.580650:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:11331:x1875614914118272:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:2.0:1788726066.580989:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:11331:x1875614914118272:12345-192.168.201.42@tcp:35:bash.0 Request processed in 341us (570us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788726066.580996:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:0.0:1788726066.605615:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726066.605694:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914118400 00000100:00100000:2.0:1788726066.605705:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914118400 00002000:00100000:2.0:1788726066.605761:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91a141d2ce00 x1875614914118400/t0(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:462/0 lens 504/0 e 0 to 0 dl 1788726077 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788726066.605773:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a141d2ce00 with x1875614914118400 ext(0->12) 00002000:00010000:2.0:1788726066.605780:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a141d2ce00 00000100:00100000:2.0:1788726066.605820:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:2.0:1788726066.605830:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2351:x1875614914118400:12345-192.168.201.42@tcp:4:bash.0 00000100:00100000:2.0:1788726066.606640:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2351:x1875614914118400:12345-192.168.201.42@tcp:4:bash.0 Request processed in 808us (1035us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788726066.606649:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00002000:00100000:2.0:1788726066.606658:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91a141d2ce00 x1875614914118400/t4294967305(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:462/0 lens 504/448 e 0 to 0 dl 1788726077 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788726066.606667:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a141d2ce00 with x1875614914118400 ext(0->12) 00002000:00010000:2.0:1788726066.606671:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a141d2ce00 00000100:00100000:1.0:1788726066.616369:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726066.616525:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914118528 00000100:00100000:0.0:1788726066.616538:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914118528 00000100:00100000:0.0:1788726066.616608:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:0.0:1788726066.616619:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2352:x1875614914118528:12345-192.168.201.42@tcp:16:kworker.0 00000100:00100000:2.0:1788726066.698773:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2352:x1875614914118528:12345-192.168.201.42@tcp:16:kworker.0 Request processed in 82141us (82411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726066.698791:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00000001:00080000:3.0:1788726066.699370:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1788726066.715589:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726066.715713:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914118784 00000100:00100000:0.0:1788726066.715724:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914118784 00000100:00100000:0.0:1788726066.716024:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:0.0:1788726066.716037:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:11341:x1875614914118784:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726066.716127:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726066.716161:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1a92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a1d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726066.716282:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788726066.716613:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1a92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1d8 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.716628:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d500) 00010000:00010000:0.0:1788726066.716631:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788726066.716636:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1a92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1d8 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.716650:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724600, rc 0) 00000100:00100000:0.0:1788726066.716756:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:11341:x1875614914118784:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 721us (1177us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788726066.716776:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 144 00000100:00100000:2.0:1788726066.721466:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726066.721665:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914119040 00000100:00100000:1.0:1788726066.721679:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914119040 00000100:00100000:1.0:1788726066.721745:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:1.0:1788726066.721758:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:11341:x1875614914119040:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:1.0:1788726066.722258:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:11341:x1875614914119040:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 501us (799us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788726066.722267:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:1.0:1788726066.800318:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726066.800542:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914119168 00000100:00100000:2.0:1788726066.800552:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914119168 00000100:00100000:2.0:1788726066.800616:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 145 00000100:00100000:2.0:1788726066.800626:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:11347:x1875614914119168:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726066.800650:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726066.800670:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1aa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a1df expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.800730:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1aa7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.800744:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.800756:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726066.800788:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788726066.800791:0:7629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726066.801040:0:7629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.801122:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1aa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1df expref: 23 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.801151:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1df expref: 22 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.801160:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:2.0:1788726066.801162:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788726066.801180:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eaa00, rc 0) 00000100:00100000:2.0:1788726066.801308:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:11347:x1875614914119168:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 682us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726066.801316:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 145 00000100:00100000:2.0:1788726066.809109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726066.809302:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914119424 00000100:00100000:3.0:1788726066.809312:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914119424 00000100:00100000:3.0:1788726066.809372:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:3.0:1788726066.809383:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:11347:x1875614914119424:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726066.809406:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726066.809430:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1aae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a1e6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.809550:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ab5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.809568:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.809579:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726066.809588:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788726066.809710:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1aae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1e6 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.809725:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1e6 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.809733:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a10d14da00) 00010000:00010000:3.0:1788726066.809735:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726066.809738:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915400, rc 0) 00000100:00100000:3.0:1788726066.809791:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:11347:x1875614914119424:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 411us (694us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788726066.809797:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 146 00000100:00100000:0.0:1788726066.813068:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726066.813209:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914119680 00000100:00100000:3.0:1788726066.813256:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914119680 00000100:00100000:3.0:1788726066.813313:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 147 00000100:00100000:3.0:1788726066.813323:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:11347:x1875614914119680:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726066.813348:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726066.813381:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1ac3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a1ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.813474:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1aca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.813488:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1aca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.813499:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1aca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726066.813510:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788726066.813627:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1ac3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1ed expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.813645:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1aca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1ed expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.813655:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a10d14da00) 00010000:00010000:3.0:1788726066.813658:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788726066.813661:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914800, rc 0) 00000100:00100000:3.0:1788726066.813725:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:11347:x1875614914119680:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 402us (679us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788726066.813733:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 147 00000100:00100000:1.0:1788726066.816630:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726066.817028:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914119808 00000100:00100000:2.0:1788726066.817037:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914119808 00000100:00100000:2.0:1788726066.817466:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:2.0:1788726066.817479:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:2350:x1875614914119808:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726066.817496:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726066.817524:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ab5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1e6 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.817544:0:8495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a10d14da00) 00010000:00010000:2.0:1788726066.817549:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726066.817616:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+25:2350:x1875614914119808:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 140us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726066.817624:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:1.0:1788726066.822447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726066.822656:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914119936 00000100:00100000:2.0:1788726066.822668:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914119936 00000100:00100000:2.0:1788726066.822751:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:2.0:1788726066.822760:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2351:x1875614914119936:12345-192.168.201.42@tcp:1:lfs.0 00010000:00010000:2.0:1788726066.822895:0:9742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000522c5e16/0xcbde9110e47c1ad8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.822913:0:9742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c1a8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1d1 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.822928:0:9742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726066.822931:0:9742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788726066.822935:0:9742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000522c5e16/0xcbde9110e47c1ad8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.822963:0:9742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c1a8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1d1 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.822973:0:9742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c1a8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1d1 expref: 6 pid: 6683 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726066.822984:0:9742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9742:1875614935097984:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788726066.823093:0:9742:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a139cde840 going to sleep for 11 seconds 00000100:00100000:0.0:1788726066.835370:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726066.835893:0:9742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9742:1875614935097984:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726066.835920:0:9742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000522c5e16/0xcbde9110e47c1ad8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726066.836257:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914120064 00000100:00100000:1.0:1788726066.836264:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914120064 00010000:00010000:1.0:1788726066.836571:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c1a8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1d1 expref: 7 pid: 6683 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726066.836609:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:1.0:1788726066.836619:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914120064:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726066.836636:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788726066.836656:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788726066.836660:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788726066 00002000:00010000:1.0:1788726066.836662:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788726066 00002000:00010000:1.0:1788726066.836664:0:5819:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788726066.836670:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c1a8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1d1 expref: 7 pid: 6683 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.836704:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c1a8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1d1 expref: 7 pid: 6683 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.836726:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c1a8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1d1 expref: 7 pid: 6683 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.836738:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788726066.836742:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788726066.836747:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000522c5e16/0xcbde9110e47c1ad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.836754:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000522c5e16/0xcbde9110e47c1ad8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726066.836781:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726066.836848:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914120064:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 230us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726066.836855:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 63 00010000:00010000:2.0:1788726066.837342:0:9742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000522c5e16/0xcbde9110e47c1ad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.837353:0:9742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000522c5e16/0xcbde9110e47c1ad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.837380:0:9742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000522c5e16/0xcbde9110e47c1ad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.837396:0:9742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000522c5e16/0xcbde9110e47c1ad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.837405:0:9742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000522c5e16/0xcbde9110e47c1ad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.837412:0:9742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb000 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726066.837417:0:9742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000522c5e16/0xcbde9110e47c1ad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.837427:0:9742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000522c5e16/0xcbde9110e47c1ad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.837441:0:9742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000522c5e16/0xcbde9110e47c1ad8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.837449:0:9742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000522c5e16/0xcbde9110e47c1ad8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726066.837505:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914119936:12345-192.168.201.42@tcp:1:lfs.0 Request processed in 14744us (15067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726066.837514:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:0.0:1788726066.840995:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726066.841071:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914120320 00000100:00100000:3.0:1788726066.841083:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914120320 00000100:00100000:3.0:1788726066.841153:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:3.0:1788726066.841164:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111084c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+25:11347:x1875614914120320:12345-192.168.201.42@tcp:35:lfs.0 00000004:00010000:3.0:1788726066.841266:0:5838:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1aca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1ed expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788726066.841559:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788726066.841604:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1788726066.842151:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1788726066.842209:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1adf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.842253:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1c3 expref: 29 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.842262:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1adf lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.842303:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1c3 expref: 29 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726066.842318:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1c3 expref: 29 pid: 7629 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726066.842333:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d33800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5838:1875614935098112:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726066.842435:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788726066.846065:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726066.846171:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914120448 00000100:00100000:0.0:1788726066.846183:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914120448 00010000:00010000:0.0:1788726066.846259:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a76 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1c3 expref: 30 pid: 7629 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726066.846298:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:0.0:1788726066.846316:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:2349:x1875614914120448:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726066.846333:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726066.846342:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a76 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1c3 expref: 30 pid: 7629 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.846366:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1c3 expref: 30 pid: 7629 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.846398:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a10d14da00) 00010000:00010000:0.0:1788726066.846405:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1adf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.846413:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1adf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.846419:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1adf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.846458:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726066.846508:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:2349:x1875614914120448:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 201us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726066.846514:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 64 00010000:00010000:2.0:1788726066.848256:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c1a76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a1c3 expref: 29 pid: 7629 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726066.848297:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d33800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5838:1875614935098112:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726066.848667:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1adf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.848680:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1adf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.848686:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1adf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788726066.848831:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788726066.849067:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788726066.849643:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875614935098240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788726066.849714:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726066.849755:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a139cde240 going to sleep for 11 seconds 00000100:00100000:1.0:1788726066.849831:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935098240 00000100:00100000:1.0:1788726066.849839:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935098240 00000100:00100000:1.0:1788726066.849895:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788726066.849904:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1875614935098240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788726066.849980:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1875614935098240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 77us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726066.849987:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788726066.850296:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1089b0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875614935098240:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788726066.851155:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788726066.851257:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a446a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875614935098368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788726066.851298:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726066.851536:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935098368 00000100:00100000:1.0:1788726066.851542:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935098368 00000100:00100000:1.0:1788726066.851585:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788726066.851600:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1875614935098368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788726066.851789:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5838:x1875614935098368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 197us (490us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788726066.851797:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788726066.852541:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a139cde840 going to sleep for 11 seconds 00000100:00100000:2.0:1788726066.852580:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a446a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875614935098368:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788726066.852766:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1788726066.852814:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1adf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.852825:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1adf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.852845:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1adf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.852851:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726066.852856:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1adf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.852863:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1adf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.852881:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a10d14da00) 00010000:00010000:2.0:1788726066.852884:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788726066.852890:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1adf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726066.852896:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1adf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788726066.853111:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788726066.854029:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1788726066.854043:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361903826275ns, next at 362903824015ns, rc = 0 00000001:00080000:2.0:1788726066.854050:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1788726066.854095:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a10d14da00) 00010000:00010000:2.0:1788726066.854099:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788726066.854108:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1aca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1ed expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726066.854624:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111084c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+32:11347:x1875614914120320:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 13460us (13637us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1788726066.854648:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00000020:00080000:2.0:1788726066.854654:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788726066.858890:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726066.858999:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914120576 00000100:00100000:0.0:1788726066.859010:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914120576 00000100:00100000:0.0:1788726066.859108:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 148 00000100:00100000:0.0:1788726066.859136:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+32:11347:x1875614914120576:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726066.859164:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726066.859190:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1ae6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a1f4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.859289:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1f4 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.859303:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1f4 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726066.859326:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:0.0:1788726066.859329:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788726066.859333:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725200, rc 0) 00000100:00100000:0.0:1788726066.859607:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+33:11347:x1875614914120576:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 478us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726066.859615:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 148 00000100:00100000:1.0:1788726066.864511:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726066.864668:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914120832 00000100:00100000:2.0:1788726066.864680:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914120832 00000100:00100000:2.0:1788726066.864782:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:2.0:1788726066.864793:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+33:11347:x1875614914120832:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:2.0:1788726066.865057:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+34:11347:x1875614914120832:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 266us (556us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788726066.865065:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:2.0:1788726066.905683:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935098496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788726066.905757:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726066.919271:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935098496 00000100:00100000:0.0:1788726066.919288:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935098496 00000100:00100000:0.0:1788726066.919562:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788726066.919574:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13aefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875614935098496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788726066.919666:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788726066.919757:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13aefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875614935098496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (13999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726066.919764:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788726066.923107:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935098496:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788726067.011087:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967419 is committed 00000001:00080000:1.0:1788726067.011106:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967420 is committed 00000001:00080000:1.0:1788726067.011115:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967432 is committed 00000004:00080000:1.0:1788726067.011123:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788726067.011155:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a139cde240 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788726067.011161:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a10316cd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a139cde9c0 00000020:00080000:1.0:1788726067.011164:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a108874f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a13f48e000 00000100:00100000:3.0:1788726067.011547:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935098624:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1788726067.011946:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:3.0:1788726067.012042:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788726067.012155:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788726067.012585:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935098624 00000100:00100000:0.0:1788726067.012662:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935098624 00000100:00100000:0.0:1788726067.012731:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788726067.012741:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875614935098624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788726067.012775:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1788726067.012811:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9dcb32, atime: 0x0, ctime: 0x6a9dcb32, blocks: 0xb 00010000:00010000:0.0:1788726067.012819:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e34421f/0xcbde9110e47c1aed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.012838:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=362s v=(0 0) 00010000:00010000:0.0:1788726067.012842:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726067.012848:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e34421f/0xcbde9110e47c1aed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.012865:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e34421f/0xcbde9110e47c1aed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.012876:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e34421f/0xcbde9110e47c1aed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.012884:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e34421f/0xcbde9110e47c1aed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.012912:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726067.013625:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726067.013636:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e34421f/0xcbde9110e47c1aed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.013647:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726067.013652:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e34421f/0xcbde9110e47c1aed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.013661:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e34421f/0xcbde9110e47c1aed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.013695:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e34421f/0xcbde9110e47c1aed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.013702:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e34421f/0xcbde9110e47c1aed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.013722:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726067.013724:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726067.013726:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788726067.016953:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788726067.018198:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a141d2d500/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788726067.018239:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935098624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788726067.018430:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726067.018504:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914121088 00000100:00100000:3.0:1788726067.018511:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914121088 00000100:00100000:0.0:1788726067.018559:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1875614935098624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5378us (6074us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788726067.018561:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 149 00000100:00100000:0.0:1788726067.018568:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788726067.018571:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+16:11357:x1875614914121088:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726067.018591:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726067.018612:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1af4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a1fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726067.018703:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788726067.018913:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1af4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1fb expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.018927:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d500) 00010000:00010000:3.0:1788726067.018929:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788726067.018934:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1af4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1fb expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.018945:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915000, rc 0) 00000100:00100000:3.0:1788726067.018994:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+17:11357:x1875614914121088:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 425us (567us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788726067.019000:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 149 00000100:00100000:1.0:1788726067.023924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726067.023987:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914121216 00000100:00100000:3.0:1788726067.023996:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914121216 00000100:00100000:3.0:1788726067.024046:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 150 00000100:00100000:3.0:1788726067.024067:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+17:11357:x1875614914121216:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:3.0:1788726067.024166:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024194:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024206:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024256:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024264:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024271:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024559:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024566:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024571:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788726067.024609:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024621:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024627:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024644:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024650:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726067.024655:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024661:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024670:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:3.0:1788726067.024672:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726067.024675:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024680:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024689:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024692:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024696:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024699:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726067.024700:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024710:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024714:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a111639000) 00010000:00010000:3.0:1788726067.024716:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726067.024717:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024720:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024730:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024733:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024737:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024739:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726067.024741:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024744:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024747:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:3.0:1788726067.024748:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726067.024750:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.024758:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726067.024834:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+17:11357:x1875614914121216:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 769us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726067.024839:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 150 00000100:00100000:0.0:1788726067.029581:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726067.031615:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914121472 00000100:00100000:3.0:1788726067.031630:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914121472 00000100:00100000:2.0:1788726067.031738:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:2.0:1788726067.031752:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+17:11357:x1875614914121472:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:2.0:1788726067.032090:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:11357:x1875614914121472:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 341us (2521us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788726067.032100:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:1.0:1788726067.083920:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726067.084012:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914121728 00000100:00100000:3.0:1788726067.084023:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914121728 00000100:00100000:3.0:1788726067.084086:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 151 00000100:00100000:3.0:1788726067.084097:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:11360:x1875614914121728:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726067.084140:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726067.084164:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a202 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.084291:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b1e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.084306:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.084317:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.084334:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.084348:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.084369:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.084914:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1b2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.084925:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.084933:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726067.084944:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788726067.085037:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085045:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085051:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085058:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726067.085062:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085070:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b1e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085082:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:3.0:1788726067.085085:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726067.085096:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085102:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1b1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085115:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085576:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085583:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085597:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726067.085601:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085607:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085615:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a111639000) 00010000:00010000:3.0:1788726067.085618:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726067.085621:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085626:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085697:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a202 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085721:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1b2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a202 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.085728:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:3.0:1788726067.085730:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726067.085732:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915200, rc 0) 00000100:00100000:3.0:1788726067.085799:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:11360:x1875614914121728:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1704us (1891us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788726067.085807:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 151 00000100:00100000:1.0:1788726067.090317:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726067.090812:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914121856 00000100:00100000:0.0:1788726067.090824:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914121856 00000100:00100000:0.0:1788726067.090923:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 152 00000100:00100000:0.0:1788726067.090935:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:11360:x1875614914121856:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:0.0:1788726067.091007:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1b3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.091024:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.091035:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.091066:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.091074:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1b3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.091080:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1b3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.091086:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726067.091091:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1b3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.091112:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1b3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.091200:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:0.0:1788726067.091203:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788726067.091207:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1b3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.091213:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1b3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726067.091559:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:11360:x1875614914121856:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 625us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726067.091568:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 152 00000100:00100000:0.0:1788726067.095993:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726067.096076:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914122112 00000100:00100000:2.0:1788726067.096086:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914122112 00000100:00100000:2.0:1788726067.096162:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:2.0:1788726067.096173:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:11360:x1875614914122112:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:2.0:1788726067.096859:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:11360:x1875614914122112:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 685us (874us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788726067.096870:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00010000:00010000:2.0:1788726067.221529:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726067.447842:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726067.447950:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914122368 00000100:00100000:2.0:1788726067.447961:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914122368 00000100:00100000:2.0:1788726067.448042:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 153 00000100:00100000:2.0:1788726067.448063:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:11391:x1875614914122368:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:2.0:1788726067.448090:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726067.448110:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1b41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a209 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.448263:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.448278:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.448290:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726067.448302:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788726067.448750:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1b41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a209 expref: 24 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.448771:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a209 expref: 23 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.448780:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:2.0:1788726067.448782:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726067.448785:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eb800, rc 0) 00000100:00100000:2.0:1788726067.448890:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:11391:x1875614914122368:12345-192.168.201.42@tcp:101:cat.0 Request processed in 829us (1056us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788726067.448898:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 153 00000100:00100000:1.0:1788726067.459012:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726067.459143:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914122624 00000100:00100000:0.0:1788726067.459154:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914122624 00000100:00100000:0.0:1788726067.459235:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:0.0:1788726067.459246:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:11391:x1875614914122624:12345-192.168.201.42@tcp:35:cat.0 00000100:00100000:0.0:1788726067.460179:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:11391:x1875614914122624:12345-192.168.201.42@tcp:35:cat.0 Request processed in 929us (1171us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788726067.460190:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:1.0:1788726067.466725:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726067.470767:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914122752 00000100:00100000:2.0:1788726067.470802:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914122752 00000100:00100000:2.0:1788726067.470885:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:2.0:1788726067.470896:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1128e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:2350:x1875614914122752:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726067.470913:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726067.470939:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a209 expref: 24 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.470961:0:8495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:2.0:1788726067.470966:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726067.471042:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1128e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:2350:x1875614914122752:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 147us (4325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726067.471179:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:2.0:1788726067.554553:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726067.554824:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914123008 00000100:00100000:3.0:1788726067.554835:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914123008 00000100:00100000:3.0:1788726067.554895:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 154 00000100:00100000:3.0:1788726067.554906:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:11397:x1875614914123008:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:3.0:1788726067.554932:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726067.554934:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788726067.554962:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1aa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1df expref: 23 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.554979:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:3.0:1788726067.554984:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788726067.554996:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b56 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a210 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.555106:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.555146:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1b2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a202 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.555154:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.555186:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1b2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a202 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.555199:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1b2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a202 expref: 23 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726067.555211:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d31500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935098752:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726067.556034:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10332d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726067.562163:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726067.562354:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d31500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935098752:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788726067.562392:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726067.562535:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914123136 00000100:00100000:2.0:1788726067.562543:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914123136 00010000:00010000:2.0:1788726067.562592:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1b2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a202 expref: 24 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726067.562632:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:2.0:1788726067.562643:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:2349:x1875614914123136:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726067.562658:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726067.562665:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1b2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a202 expref: 24 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.562678:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1b2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a202 expref: 24 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.562721:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1b2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a202 expref: 24 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.562737:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:2.0:1788726067.562742:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.562752:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.562759:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.562789:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726067.562843:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:2349:x1875614914123136:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 201us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726067.562851:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 65 00010000:00010000:3.0:1788726067.563060:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.563068:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726067.563088:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788726067.563310:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a210 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.563339:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a210 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.563347:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:3.0:1788726067.563349:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788726067.563352:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915c00, rc 0) 00000100:00100000:3.0:1788726067.563483:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:11397:x1875614914123008:12345-192.168.201.42@tcp:101:dd.0 Request processed in 8578us (8939us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788726067.563491:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 154 00000100:00100000:1.0:1788726067.568162:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726067.568434:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914123392 00000100:00100000:2.0:1788726067.568445:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914123392 00000100:00100000:2.0:1788726067.568503:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 155 00000100:00100000:2.0:1788726067.568515:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:11397:x1875614914123392:12345-192.168.201.42@tcp:36:dd.0 00010000:00010000:2.0:1788726067.569011:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.569031:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.569057:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788726067.569141:0:7629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788726067.569170:0:7629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfa0511b reply state 00000000bba517d1 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726067.569179:0:7629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788726067.570027:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:11397:x1875614914123392:12345-192.168.201.42@tcp:36:dd.0 Request processed in 1507us (1869us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788726067.570038:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 155 00000020:00080000:2.0:1788726067.570172:0:7629:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788726067.580807:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.580831:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.580859:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.580866:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726067.580871:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.580879:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.580899:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:0.0:1788726067.580903:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726067.580908:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.580914:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726067.981275:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726067.982005:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914123520 00000100:00100000:2.0:1788726067.982016:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914123520 00000100:00100000:2.0:1788726067.982091:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 156 00000100:00100000:2.0:1788726067.982103:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+25:11411:x1875614914123520:12345-192.168.201.42@tcp:101:stat.0 00010000:00010000:2.0:1788726067.982137:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726067.982157:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1b72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a217 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.982257:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1b79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.982271:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1b79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.982284:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1b79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.982300:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1b80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.982522:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.982531:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.983108:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.983131:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a210 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.983140:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b87 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.983176:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a210 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.983191:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a210 expref: 26 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726067.983205:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875614935098880:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788726067.984153:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a103c4acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726067.988379:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726067.988526:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914123776 00000100:00100000:3.0:1788726067.988545:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914123776 00000100:00100000:3.0:1788726067.988611:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:3.0:1788726067.988621:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:5591:x1875614914123776:12345-192.168.201.42@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788726067.988946:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:5591:x1875614914123776:12345-192.168.201.42@tcp:35:ldlm_bl.0 Request processed in 324us (584us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788726067.988954:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:2.0:1788726067.991268:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875614935098880:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726067.991298:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726067.994905:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726067.995076:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914123904 00000100:00100000:3.0:1788726067.995086:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914123904 00010000:00010000:3.0:1788726067.995139:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a210 expref: 28 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726067.995184:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:3.0:1788726067.995195:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:2349:x1875614914123904:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726067.995210:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726067.995274:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a210 expref: 28 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.995288:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a210 expref: 28 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.995328:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a210 expref: 28 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.995346:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:3.0:1788726067.995351:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.995361:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.995377:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b87 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726067.995409:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726067.995463:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:2349:x1875614914123904:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 269us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726067.995470:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 66 00010000:00010000:2.0:1788726067.995778:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.995796:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726067.995853:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788726067.995859:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726067.995885:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.995899:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.995909:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1b79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.995915:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1b79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.995922:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1b79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.995928:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726067.995932:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1b79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.995939:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1b79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.995949:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:2.0:1788726067.995952:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726067.995955:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1b79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.995972:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1b79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.995983:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.995987:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1b80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.995992:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1b80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.995997:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eae00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726067.996000:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1b80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.996005:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1b80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.996012:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a11214cb00) 00010000:00010000:2.0:1788726067.996014:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726067.996017:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1b80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.996022:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1b80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.996067:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1b72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a217 expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.996080:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a217 expref: 26 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.996093:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:2.0:1788726067.996096:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726067.996099:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eb800, rc 0) 00000100:00100000:2.0:1788726067.996138:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:11411:x1875614914123520:12345-192.168.201.42@tcp:101:stat.0 Request processed in 14037us (14872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726067.996144:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 156 00000040:00080000:2.0:1788726068.054388:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788726068.054398:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788726068.054874:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788726068.054882:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788726068.110325:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726068.110699:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914124160 00000100:00100000:3.0:1788726068.110710:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914124160 00000100:00100000:3.0:1788726068.110779:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 157 00000100:00100000:3.0:1788726068.110790:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:11417:x1875614914124160:12345-192.168.201.42@tcp:36:truncate.0 00010000:00010000:3.0:1788726068.110851:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726068.110880:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1b87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a217 expref: 26 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.110921:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:3.0:1788726068.110926:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788726068.111169:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.111183:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.111193:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788726068.111281:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000100:00080000:1.0:1788726068.111778:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1788726068.111811:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d14871ce reply state 00000000144f0029 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726068.111822:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788726068.111935:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:11417:x1875614914124160:12345-192.168.201.42@tcp:36:truncate.0 Request processed in 1146us (1633us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788726068.111944:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 157 00000020:00080000:3.0:1788726068.111949:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788726068.120497:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.120516:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.120523:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.120529:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726068.120560:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.120569:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.120588:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:3.0:1788726068.120591:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726068.120595:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.120602:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.245878:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726068.305059:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726068.305163:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914124288 00000100:00100000:3.0:1788726068.305174:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914124288 00000100:00100000:3.0:1788726068.305329:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 158 00000100:00100000:3.0:1788726068.305341:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:11431:x1875614914124288:12345-192.168.201.42@tcp:101:stat.0 00010000:00010000:3.0:1788726068.305374:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726068.305396:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a21e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305460:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b9c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305474:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305485:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305498:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1ba3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305518:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305524:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305812:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1baa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305821:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305828:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726068.305863:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788726068.305868:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788726068.305891:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305902:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305911:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305918:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b9c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305923:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305939:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726068.305943:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305951:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b9c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305963:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:3.0:1788726068.305966:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726068.305971:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305976:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1b9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305988:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305994:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1ba3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.305999:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.306004:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726068.306007:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.306012:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.306030:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a111639000) 00010000:00010000:3.0:1788726068.306032:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726068.306035:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1ba3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.306041:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1ba3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.306071:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1b95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a21e expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.306085:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1baa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a21e expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.306092:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:3.0:1788726068.306094:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726068.306096:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914200, rc 0) 00000100:00100000:3.0:1788726068.306171:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:11431:x1875614914124288:12345-192.168.201.42@tcp:101:stat.0 Request processed in 832us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726068.306179:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 158 00000100:00100000:1.0:1788726068.442972:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726068.443075:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914124544 00000100:00100000:2.0:1788726068.443085:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914124544 00000100:00100000:2.0:1788726068.443183:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 159 00000100:00100000:2.0:1788726068.443194:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:11441:x1875614914124544:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726068.443262:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726068.443284:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1bb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a225 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726068.443625:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788726068.443741:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1bb1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a225 expref: 30 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.443757:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d500) 00010000:00010000:2.0:1788726068.443760:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788726068.443766:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1bb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a225 expref: 30 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.443795:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eb000, rc 0) 00000100:00100000:2.0:1788726068.443854:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:11441:x1875614914124544:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 662us (890us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788726068.443862:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 159 00000100:00100000:1.0:1788726068.456946:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726068.457608:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914124800 00000100:00100000:3.0:1788726068.457620:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914124800 00000100:00100000:3.0:1788726068.457741:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:3.0:1788726068.457753:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111086050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:11441:x1875614914124800:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788726068.458090:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111086050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:11441:x1875614914124800:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 279us (1390us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788726068.458099:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:1.0:1788726068.526934:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726068.527024:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914125056 00000100:00100000:2.0:1788726068.527036:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914125056 00000100:00100000:2.0:1788726068.527097:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 160 00000100:00100000:2.0:1788726068.527119:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+30:11447:x1875614914125056:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788726068.527145:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726068.527168:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1bbf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a22c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.527328:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.527345:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1baa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a21e expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.527354:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.527743:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1baa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a21e expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.527758:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1baa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a21e expref: 31 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726068.527793:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875614935099008:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788726068.527894:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a103c4af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788726068.531068:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726068.531172:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914125184 00000100:00100000:3.0:1788726068.531182:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914125184 00010000:00010000:3.0:1788726068.531264:0:8495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1baa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a21e expref: 32 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726068.531319:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:3.0:1788726068.531330:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+32:2350:x1875614914125184:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726068.531343:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726068.531348:0:8495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1baa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a21e expref: 32 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.531366:0:8495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1baa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a21e expref: 32 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.531384:0:8495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:3.0:1788726068.531388:0:8495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.531396:0:8495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.531401:0:8495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.531417:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726068.531458:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+32:2350:x1875614914125184:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 132us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726068.531463:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 67 00010000:00010000:2.0:1788726068.532167:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1baa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a21e expref: 31 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726068.532186:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875614935099008:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726068.532205:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.532532:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.532541:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726068.532561:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788726068.532727:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1bbf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a22c expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.532744:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a22c expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.532753:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:2.0:1788726068.532756:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788726068.532759:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eae00, rc 0) 00000100:00100000:2.0:1788726068.532809:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+31:11447:x1875614914125056:12345-192.168.201.42@tcp:101:bash.0 Request processed in 5692us (5884us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788726068.532833:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 160 00000100:00100000:1.0:1788726068.535642:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726068.535722:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914125440 00000100:00100000:3.0:1788726068.535744:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914125440 00000100:00100000:3.0:1788726068.535829:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 161 00000100:00100000:3.0:1788726068.535837:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+31:11447:x1875614914125440:12345-192.168.201.42@tcp:36:bash.0 00010000:00010000:3.0:1788726068.536080:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1bd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.536098:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.536121:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788726068.536174:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788726068.536199:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a424b37f reply state 00000000480ea176 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726068.536208:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788726068.536404:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+34:11447:x1875614914125440:12345-192.168.201.42@tcp:36:bash.0 Request processed in 566us (770us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788726068.536410:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 161 00000020:00080000:3.0:1788726068.536415:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788726068.541650:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.541668:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1bd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.541676:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1bd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.541681:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726068.541686:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1bd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.541712:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1bd4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.541730:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:0.0:1788726068.541732:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726068.541737:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1bd4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.541742:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1bd4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726068.543562:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726068.543714:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914125568 00000100:00100000:2.0:1788726068.543726:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914125568 00000100:00100000:2.0:1788726068.543783:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 162 00000100:00100000:2.0:1788726068.543795:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+33:11447:x1875614914125568:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788726068.543821:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726068.543840:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1bdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a233 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.543924:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1be2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.543939:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a22c expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.543947:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1be2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.543980:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a22c expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.543993:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a22c expref: 34 pid: 5836 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726068.544006:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935099136:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788726068.544133:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a103c4acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726068.546783:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726068.546861:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914125696 00000100:00100000:0.0:1788726068.546872:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914125696 00010000:00010000:0.0:1788726068.546913:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a22c expref: 35 pid: 5836 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726068.546957:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:0.0:1788726068.546968:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:2349:x1875614914125696:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726068.546985:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726068.546993:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a22c expref: 35 pid: 5836 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.547007:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a22c expref: 35 pid: 5836 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.547031:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:0.0:1788726068.547036:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1be2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.547063:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.547072:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1be2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.547094:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726068.547161:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:2349:x1875614914125696:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 194us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726068.547169:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 68 00010000:00010000:2.0:1788726068.547368:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bc6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a22c expref: 34 pid: 5836 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726068.547394:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935099136:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726068.547415:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.547424:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.547430:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726068.547481:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788726068.547485:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726068.547505:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.547534:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1bdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a233 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.547549:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1be2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a233 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.547556:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:2.0:1788726068.547558:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726068.547561:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea000, rc 0) 00000100:00100000:2.0:1788726068.547586:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+33:11447:x1875614914125568:12345-192.168.201.42@tcp:101:bash.0 Request processed in 3793us (4032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726068.547593:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 162 00000100:00100000:1.0:1788726068.552647:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726068.552731:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914125952 00000100:00100000:0.0:1788726068.552741:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914125952 00000100:00100000:0.0:1788726068.552800:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:0.0:1788726068.552811:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+33:11447:x1875614914125952:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:0.0:1788726068.553052:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+34:11447:x1875614914125952:12345-192.168.201.42@tcp:35:bash.0 Request processed in 243us (416us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788726068.553060:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:1.0:1788726068.653542:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726068.653629:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914126208 00000100:00100000:2.0:1788726068.653639:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914126208 00000100:00100000:2.0:1788726068.653703:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 163 00000100:00100000:2.0:1788726068.653714:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a90b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+34:11457:x1875614914126208:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726068.653741:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726068.653763:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1be9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a23a expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726068.653859:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788726068.653998:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1be9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a23a expref: 36 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.654013:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d500) 00010000:00010000:2.0:1788726068.654015:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788726068.654021:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1be9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a23a expref: 36 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.654038:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eb000, rc 0) 00000100:00100000:2.0:1788726068.654115:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a90b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:11457:x1875614914126208:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 402us (582us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788726068.654123:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 163 00000100:00100000:1.0:1788726068.657926:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726068.658065:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914126336 00000100:00100000:2.0:1788726068.658075:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914126336 00000100:00100000:2.0:1788726068.658151:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 164 00000100:00100000:2.0:1788726068.658162:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:11457:x1875614914126336:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:2.0:1788726068.658273:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bf7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658322:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658335:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658351:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1bfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658367:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1bfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658373:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1bfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658658:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658668:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658676:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788726068.658717:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658730:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658736:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bf7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658753:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658760:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eae00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726068.658764:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658771:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bf7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658784:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:2.0:1788726068.658788:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726068.658792:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658799:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1bf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658811:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1bfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658817:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1bfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658822:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1bfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658827:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eaa00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726068.658829:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1bfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658844:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1bfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658853:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a11214cb00) 00010000:00010000:2.0:1788726068.658855:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726068.658858:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1bfe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658865:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1bfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658879:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658885:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658891:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658897:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726068.658899:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658906:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658912:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:2.0:1788726068.658914:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726068.658916:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.658931:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726068.659018:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:11457:x1875614914126336:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 856us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726068.659026:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 164 00000100:00100000:2.0:1788726068.664048:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726068.664141:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914126592 00000100:00100000:3.0:1788726068.664152:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914126592 00000100:00100000:3.0:1788726068.664242:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:3.0:1788726068.664253:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:11457:x1875614914126592:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788726068.664464:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+36:11457:x1875614914126592:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 214us (426us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788726068.664470:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:1.0:1788726068.699551:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726068.700956:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914126848 00000100:00100000:2.0:1788726068.700970:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914126848 00000100:00100000:2.0:1788726068.701106:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 165 00000100:00100000:2.0:1788726068.701118:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+36:11460:x1875614914126848:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726068.701144:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726068.701164:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a241 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.701320:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1c13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.701335:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1c13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.701347:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1c13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.701551:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1c1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.701560:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.701579:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.703245:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1c21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.703264:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.703275:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726068.703287:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788726068.703995:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1c13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704005:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1c13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704012:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1c13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704018:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eaa00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726068.704022:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1c13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704030:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1c13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704042:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:2.0:1788726068.704045:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726068.704062:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1c13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704069:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1c13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704084:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704090:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1c1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704105:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704111:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eae00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726068.704114:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704120:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1c1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704129:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a11214cb00) 00010000:00010000:2.0:1788726068.704131:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726068.704134:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1c1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704140:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1c1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704194:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a241 expref: 39 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704273:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1c21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a241 expref: 38 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.704281:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:2.0:1788726068.704284:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726068.704286:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eb000, rc 0) 00000100:00100000:2.0:1788726068.704773:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+38:11460:x1875614914126848:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 3653us (5229us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788726068.704782:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 165 00000100:00100000:1.0:1788726068.710686:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726068.710763:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726068.710839:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914127104 00000100:00100000:0.0:1788726068.710850:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914127104 00000100:00100000:0.0:1788726068.710919:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:0.0:1788726068.710931:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+38:2349:x1875614914127104:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726068.710948:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726068.710975:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1c21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a241 expref: 38 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.710998:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:0.0:1788726068.711016:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726068.711076:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+37:2349:x1875614914127104:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 145us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726068.711084:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:2.0:1788726068.712520:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914126976 00000100:00100000:2.0:1788726068.712534:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914126976 00000100:00100000:2.0:1788726068.712638:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 166 00000100:00100000:2.0:1788726068.712650:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+37:11460:x1875614914126976:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:2.0:1788726068.712747:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.712767:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.712779:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.712807:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.712814:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.712832:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.712838:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726068.712843:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.712851:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.712864:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:2.0:1788726068.712867:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788726068.712872:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.712879:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726068.712962:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+37:11460:x1875614914126976:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 313us (2286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726068.712970:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 166 00000100:00100000:1.0:1788726068.715655:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726068.715884:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914127360 00000100:00100000:3.0:1788726068.715907:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914127360 00000100:00100000:3.0:1788726068.715965:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:3.0:1788726068.715976:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+37:11460:x1875614914127360:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:3.0:1788726068.716504:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+38:11460:x1875614914127360:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 528us (857us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788726068.716514:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:1.0:1788726068.861021:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726068.861121:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914127616 00000100:00100000:3.0:1788726068.861134:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914127616 00000100:00100000:3.0:1788726068.861196:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 167 00000100:00100000:3.0:1788726068.861208:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+38:11478:x1875614914127616:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:3.0:1788726068.861274:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726068.861293:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1c36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a248 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.861388:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1c3d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.861402:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1c3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.861413:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1c3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726068.861424:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788726068.861550:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1c36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a248 expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.861568:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1c3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a248 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.861594:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:3.0:1788726068.861597:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788726068.861600:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914a00, rc 0) 00000100:00100000:3.0:1788726068.861659:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+40:11478:x1875614914127616:12345-192.168.201.42@tcp:101:cat.0 Request processed in 454us (650us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788726068.861665:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 167 00000100:00100000:1.0:1788726068.928335:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726068.928563:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914127744 00000100:00100000:3.0:1788726068.928572:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914127744 00000100:00100000:3.0:1788726068.928634:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 168 00000100:00100000:3.0:1788726068.928645:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+40:11479:x1875614914127744:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726068.928670:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726068.928691:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1c4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a24f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.928758:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1c52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.928771:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1c52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.928782:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1c52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726068.928813:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788726068.928817:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788726068.928834:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1c52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.928891:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1c4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a24f expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.928908:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1c52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a24f expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.928915:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:3.0:1788726068.928918:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788726068.928921:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914600, rc 0) 00000100:00100000:3.0:1788726068.928983:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+41:11479:x1875614914127744:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 339us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726068.928990:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 168 00000100:00100000:1.0:1788726068.936952:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726068.937310:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914128128 00000100:00100000:0.0:1788726068.937319:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914128128 00000100:00100000:0.0:1788726068.937383:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:0.0:1788726068.937394:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+41:11479:x1875614914128128:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788726068.938962:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+42:11479:x1875614914128128:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 1564us (2013us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788726068.938974:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:1.0:1788726068.942813:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726068.944720:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914128256 00000100:00100000:2.0:1788726068.944734:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914128256 00000100:00100000:2.0:1788726068.944811:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:2.0:1788726068.944822:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a909c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+42:11479:x1875614914128256:12345-192.168.201.42@tcp:103:lfs.0 00010000:00010000:2.0:1788726068.944837:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788726068.944996:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1be2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a233 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.945149:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1c3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a248 expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.945162:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1ae6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1f4 expref: 40 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.945173:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a12bdfe200) 00010000:00010000:2.0:1788726068.945183:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726068.945584:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a909c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+39:11479:x1875614914128256:12345-192.168.201.42@tcp:103:lfs.0 Request processed in 762us (2779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726068.945593:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:1.0:1788726068.950621:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726068.950709:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914128384 00000100:00100000:3.0:1788726068.950719:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914128384 00000100:00100000:3.0:1788726068.950803:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 169 00000100:00100000:3.0:1788726068.950813:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+39:11479:x1875614914128384:12345-192.168.201.42@tcp:58:lfs.0 00010000:00010000:3.0:1788726068.950944:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1c59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.950960:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1c59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.950971:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1c59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788726068.951325:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788726068.951408:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+39:11479:x1875614914128384:12345-192.168.201.42@tcp:58:lfs.0 Request processed in 595us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726068.951424:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 169 00000100:00100000:1.0:1788726068.998635:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726068.998712:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914128512 00000100:00100000:3.0:1788726068.998721:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914128512 00000100:00100000:3.0:1788726068.998779:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 170 00000100:00100000:3.0:1788726068.998788:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+39:11481:x1875614914128512:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726068.998809:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726068.998827:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1c60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a256 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.999142:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1c67 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.999161:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1c67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.999175:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1c67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.999191:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.999197:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.999203:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.000625:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1c75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.000652:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1c75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.000662:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1c75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726069.000705:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788726069.000709:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788726069.000730:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1c75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.000741:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1c75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.000750:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1c67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.000757:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1c67 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.000764:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1c67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.000770:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726069.000774:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1c67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.000782:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1c67 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.000794:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:3.0:1788726069.000796:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726069.000806:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1c67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.000813:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1c67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.000827:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.000833:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.000839:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.000845:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726069.002516:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.002535:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.002550:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a111639500) 00010000:00010000:3.0:1788726069.002553:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726069.002557:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.002564:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.002620:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1c60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a256 expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.002658:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1c75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a256 expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.002665:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a111639000) 00010000:00010000:3.0:1788726069.002668:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788726069.002670:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914c00, rc 0) 00000100:00100000:3.0:1788726069.002750:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+40:11481:x1875614914128512:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 3962us (4123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726069.002759:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 170 00000040:00080000:2.0:1788726069.077638:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788726069.077648:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788726069.077686:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788726069.077693:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788726069.077825:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116a2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875614935099264:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788726069.078422:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a103c4acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726069.084409:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726069.084923:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914128640 00000100:00100000:3.0:1788726069.084934:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914128640 00000100:00100000:3.0:1788726069.085003:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 171 00000100:00100000:3.0:1788726069.085026:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+41:11488:x1875614914128640:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788726069.085320:0:7629:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788726069.085429:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+41:11488:x1875614914128640:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 415us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726069.085437:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 171 00000100:00100000:2.0:1788726069.087658:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116a2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875614935099264:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788726069.097524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726069.097937:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914128768 00000100:00100000:2.0:1788726069.097948:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914128768 00000100:00100000:2.0:1788726069.098009:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 172 00000100:00100000:2.0:1788726069.098029:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+40:11488:x1875614914128768:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788726069.098145:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1c7c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.098178:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1c7c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.098193:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1c7c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.098933:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c83 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.098948:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.098957:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.098988:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.098997:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099003:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726069.099107:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788726069.099112:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726069.099128:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099140:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1c7c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099159:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1c7c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099166:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1c7c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099172:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726069.099177:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1c7c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099184:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1c7c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099198:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:2.0:1788726069.099201:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726069.099207:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1c7c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099212:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1c7c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099402:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099408:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c83 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099419:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c83 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099424:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726069.099432:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c83 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099439:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c83 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099447:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff91a11214cb00) 00010000:00010000:2.0:1788726069.099450:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726069.099453:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c83 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099459:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1c83 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099475:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099480:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099486:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099491:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726069.099494:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099500:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099507:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a111639000) 00010000:00010000:2.0:1788726069.099509:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726069.099522:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.099528:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1c8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726069.100537:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+40:11488:x1875614914128768:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 1598us (2105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726069.100550:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 172 00000100:00100000:1.0:1788726069.103763:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726069.104142:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914129024 00000100:00100000:3.0:1788726069.104153:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914129024 00000100:00100000:3.0:1788726069.104210:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 173 00000100:00100000:3.0:1788726069.104255:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+40:11488:x1875614914129024:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726069.104275:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726069.104295:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1c91 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a25d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.104563:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.104578:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.104590:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726069.104602:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788726069.104719:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.104727:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.104733:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.104739:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726069.104744:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.104751:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.104763:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a111639000) 00010000:00010000:3.0:1788726069.104766:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788726069.104771:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.104786:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1c98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.104828:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1c91 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a25d expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.104839:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:3.0:1788726069.104842:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788726069.104846:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1c91 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a25d expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.104856:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914400, rc 0) 00000100:00100000:3.0:1788726069.105575:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+41:11488:x1875614914129024:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1319us (1825us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788726069.105585:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 173 00000100:00100000:1.0:1788726069.109784:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726069.110029:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914129152 00000100:00100000:3.0:1788726069.110040:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914129152 00000100:00100000:3.0:1788726069.110114:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 174 00000100:00100000:3.0:1788726069.110126:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+41:11488:x1875614914129152:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788726069.110163:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788726069.110460:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+41:11488:x1875614914129152:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 334us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726069.110468:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 174 00000100:00100000:1.0:1788726069.115606:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726069.115885:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914129408 00000100:00100000:2.0:1788726069.115897:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914129408 00000100:00100000:2.0:1788726069.115960:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 175 00000100:00100000:2.0:1788726069.115971:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+41:11488:x1875614914129408:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726069.115994:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726069.115998:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788726069.116024:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1c52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a24f expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.116042:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:2.0:1788726069.116048:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788726069.116074:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1ca6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a264 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788726069.117005:0:7629:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788726069.117321:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1cad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.117336:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.117798:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.117868:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1ca6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a264 expref: 43 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.117886:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1cad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a264 expref: 42 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.117894:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a11214cb00) 00010000:00010000:2.0:1788726069.117897:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726069.117901:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea600, rc 0) 00000100:00100000:2.0:1788726069.117981:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+42:11488:x1875614914129408:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 2010us (2383us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788726069.117991:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 175 00000100:00100000:1.0:1788726069.128768:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726069.128863:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914129664 00000100:00100000:3.0:1788726069.128873:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914129664 00000100:00100000:3.0:1788726069.128931:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 176 00000100:00100000:3.0:1788726069.128949:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+42:11488:x1875614914129664:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788726069.129006:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726069.129033:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1cad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a264 expref: 42 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129062:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a11214cb00) 00010000:00010000:3.0:1788726069.129073:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788726069.129105:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129118:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129128:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129142:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cc2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa5de5035 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129148:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa5de5035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129154:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa5de5035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129415:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129422:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cbb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129438:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129444:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726069.129448:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129455:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129465:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:3.0:1788726069.129467:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726069.129470:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cbb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129476:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129486:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa5de5035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129492:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cc2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa5de5035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129497:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa5de5035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129502:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726069.129505:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa5de5035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129521:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cc2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa5de5035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129529:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa5de5035 (ffff91a111639500) 00010000:00010000:3.0:1788726069.129531:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726069.129534:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cc2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa5de5035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.129539:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cc2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa5de5035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726069.129619:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+41:11488:x1875614914129664:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 670us (859us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788726069.129627:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 176 00000100:00100000:1.0:1788726069.142183:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726069.142300:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914129792 00000100:00100000:3.0:1788726069.142311:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914129792 00000100:00100000:3.0:1788726069.142379:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 177 00000100:00100000:3.0:1788726069.142390:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+41:11488:x1875614914129792:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726069.142412:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726069.142432:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a26b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.142464:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.142478:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.142489:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.142594:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a26b expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.142613:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a26b expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.142621:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a111639500) 00010000:00010000:3.0:1788726069.142624:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788726069.142627:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914400, rc 0) 00000100:00100000:3.0:1788726069.142687:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+42:11488:x1875614914129792:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 300us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726069.142693:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 177 00000100:00100000:1.0:1788726069.150248:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726069.150435:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914130048 00000100:00100000:3.0:1788726069.150446:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914130048 00000100:00100000:3.0:1788726069.150508:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 178 00000100:00100000:3.0:1788726069.150529:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+42:11488:x1875614914130048:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788726069.150610:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.150628:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.150640:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788726069.150972:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788726069.150982:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364200765560ns, next at 365200763465ns, rc = 0 00000004:00010000:3.0:1788726069.151085:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a033adf reply state 000000000b463a57 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726069.151106:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788726069.151252:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+44:11488:x1875614914130048:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 690us (999us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788726069.151260:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 178 00010000:00010000:3.0:1788726069.156495:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.156511:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.156520:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.156525:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726069.156530:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.156537:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.156553:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a111639500) 00010000:00010000:3.0:1788726069.156556:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788726069.156560:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.156566:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1cd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726069.159388:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726069.159723:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914130176 00000100:00100000:3.0:1788726069.159750:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914130176 00000100:00100000:3.0:1788726069.159812:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 179 00000100:00100000:3.0:1788726069.159822:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+43:11488:x1875614914130176:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726069.159846:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726069.159866:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1cde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a272 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.159930:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1cde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a272 expref: 44 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.159945:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1cde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a272 expref: 44 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.159967:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a111639500) 00010000:00010000:3.0:1788726069.159971:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788726069.159974:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915e00, rc 0) 00000100:00100000:3.0:1788726069.160035:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+44:11488:x1875614914130176:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 214us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726069.160041:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 179 00000100:00100000:1.0:1788726069.166024:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726069.166143:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914130304 00000100:00100000:0.0:1788726069.166156:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914130304 00000100:00100000:0.0:1788726069.166268:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:0.0:1788726069.166279:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914130304:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788726069.166650:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914130304:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 372us (639us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788726069.166658:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00080000:1.0:1788726069.167193:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788726069.174354:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726069.176251:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914130560 00000100:00100000:0.0:1788726069.176266:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914130560 00000100:00100000:0.0:1788726069.176331:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:0.0:1788726069.176344:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+44:11488:x1875614914130560:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788726069.176590:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+45:11488:x1875614914130560:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 248us (2246us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788726069.176599:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:3.0:1788726069.181357:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726069.181495:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914130816 00000100:00100000:0.0:1788726069.181506:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914130816 00000100:00100000:0.0:1788726069.181568:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 180 00000100:00100000:0.0:1788726069.181579:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+45:11488:x1875614914130816:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788726069.181707:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+45:11488:x1875614914130816:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 129us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726069.181714:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 180 00000100:00100000:1.0:1788726069.184549:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726069.184668:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914130944 00000100:00100000:3.0:1788726069.184678:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914130944 00000100:00100000:3.0:1788726069.184742:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 181 00000100:00100000:3.0:1788726069.184753:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+45:11488:x1875614914130944:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726069.184774:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726069.184794:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1ce5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a279 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.184893:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1cec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.184907:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.184919:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726069.184955:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788726069.184975:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.185000:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1ce5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a279 expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.185017:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1cec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a279 expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.185025:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a111639500) 00010000:00010000:3.0:1788726069.185028:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788726069.185032:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914600, rc 0) 00000100:00100000:3.0:1788726069.188627:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+46:11488:x1875614914130944:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 3865us (4076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726069.188642:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 181 00000100:00100000:3.0:1788726069.192588:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726069.192702:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914131072 00000100:00100000:0.0:1788726069.192713:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914131072 00000100:00100000:0.0:1788726069.192777:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:0.0:1788726069.192790:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914131072:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788726069.192810:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726069.192830:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1cf3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a280 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726069.192857:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9dcb35, blocks: 0x1 00010000:00010000:0.0:1788726069.192875:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=364s v=(0 0) 00010000:00010000:0.0:1788726069.192880:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726069.192891:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a280 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726069.192910:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a280 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726069.192925:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725400, rc 0) 00000100:00100000:0.0:1788726069.192992:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2349:x1875614914131072:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 205us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726069.193012:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:3.0:1788726069.204332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726069.204540:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914131328 00000100:00100000:0.0:1788726069.204551:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914131328 00000100:00100000:0.0:1788726069.204610:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 182 00000100:00100000:0.0:1788726069.204621:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+46:11488:x1875614914131328:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788726069.204724:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+46:11488:x1875614914131328:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 105us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726069.204731:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 182 00000100:00100000:1.0:1788726069.210773:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726069.210853:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914131456 00000100:00100000:0.0:1788726069.210863:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914131456 00000100:00100000:0.0:1788726069.210927:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:0.0:1788726069.210940:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:11488:x1875614914131456:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788726069.210960:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726069.210977:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1cfa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a287 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726069.211007:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1cf3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a280 expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726069.211017:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726069.211022:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726069.211027:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1cfa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a287 expref: 9 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726069.211076:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a280 expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726069.211108:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1cf3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a280 expref: 9 pid: 6682 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726069.211122:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875614935099392:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726069.211235:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13aed0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788726069.226872:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726069.227175:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914131584 00000100:00100000:2.0:1788726069.227185:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914131584 00010000:00010000:2.0:1788726069.227249:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1cf3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a280 expref: 10 pid: 6682 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726069.227285:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:2.0:1788726069.227295:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1128e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:2350:x1875614914131584:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726069.227322:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726069.227344:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1cf3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a280 expref: 10 pid: 6682 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.227609:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1cf3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a280 expref: 10 pid: 6682 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.227635:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726069.227639:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726069.227648:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1cfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a287 expref: 10 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.227659:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1cfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a287 expref: 10 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.227699:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1cfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a287 expref: 10 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726069.227714:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116a2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875614935099520:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788726069.227831:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13ad3be40 going to sleep for 11 seconds 00010000:00010000:3.0:1788726069.228586:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a8f7ad3/0xcbde9110e47c1cf3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a280 expref: 10 pid: 6682 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726069.228615:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875614935099392:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788726069.228640:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1cfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a287 expref: 9 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.228654:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724600, rc 0) 00000100:00100000:3.0:1788726069.228695:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:11488:x1875614914131456:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 17757us (17928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726069.228703:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:2.0:1788726069.241679:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116a2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875614935099520:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788726069.241706:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726069.241755:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1128e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2350:x1875614914131584:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 14461us (14892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726069.241766:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:1.0:1788726069.251785:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726069.251863:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914131712 00000100:00100000:3.0:1788726069.251874:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914131712 00002000:00100000:3.0:1788726069.251930:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff91a141c4ad80 x1875614914131712/t0(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:465/0 lens 504/0 e 0 to 0 dl 1788726080 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788726069.251942:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a141c4ad80 with x1875614914131712 ext(0->8) 00002000:00010000:3.0:1788726069.251947:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a141c4ad80 00000100:00100000:3.0:1788726069.251975:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:3.0:1788726069.251984:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2350:x1875614914131712:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788726069.262334:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:2350:x1875614914131712:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 10338us (10549us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788726069.262349:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00002000:00100000:3.0:1788726069.262363:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff91a141c4ad80 x1875614914131712/t4294967314(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:465/0 lens 504/448 e 0 to 0 dl 1788726080 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788726069.262373:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a141c4ad80 with x1875614914131712 ext(0->8) 00002000:00010000:3.0:1788726069.262389:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a141c4ad80 00010000:00010000:2.0:1788726069.275107:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726069.275446:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726069.275916:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914131840 00000100:00100000:3.0:1788726069.275927:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914131840 00000100:00100000:3.0:1788726069.275994:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 183 00000100:00100000:3.0:1788726069.276004:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+46:11488:x1875614914131840:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788726069.372670:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+46:11488:x1875614914131840:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 96656us (97218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726069.372703:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 183 00000001:00080000:2.0:1788726069.372746:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1788726069.372789:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:2.0:1788726069.372801:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1788726069.372934:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788726069.372948:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788726069.373079:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935099648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788726069.373136:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726069.373197:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935099648 00000100:00100000:2.0:1788726069.373206:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935099648 00000100:00100000:2.0:1788726069.373278:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788726069.373286:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935099648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788726069.373438:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788726069.373442:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788726069 00002000:00010000:2.0:1788726069.373445:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788726069.373447:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788726069 -> 1788726069 00002000:00010000:2.0:1788726069.373448:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788726069.373483:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875614935099648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 197us (347us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788726069.373489:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788726069.373507:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788726069.373540:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a1116a2300/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788726069.373546:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935099648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788726069.377270:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726069.377317:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914131968 00000100:00100000:2.0:1788726069.377326:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914131968 00000100:00100000:2.0:1788726069.377387:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:2.0:1788726069.377398:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:2349:x1875614914131968:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788726069.449406:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1788726069.449429:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1788726069.449435:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1788726069.449711:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914131968:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 72307us (72441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726069.449723:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:2.0:1788726069.466786:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726069.467055:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914132224 00000100:00100000:0.0:1788726069.467065:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914132224 00000100:00100000:0.0:1788726069.467129:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 184 00000100:00100000:0.0:1788726069.467139:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:11488:x1875614914132224:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788726069.467192:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726069.467253:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c1cec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a279 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726069.467272:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a111639500) 00010000:00010000:0.0:1788726069.467277:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788726069.467521:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1d01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.467537:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.467546:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788726069.467811:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000944d5eaf reply state 000000000aee5417 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726069.467821:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788726069.467917:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:11488:x1875614914132224:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 778us (1140us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788726069.467925:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 184 00000100:00100000:2.0:1788726069.471720:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:0.0:1788726069.471793:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726069.471804:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1d01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726069.471812:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1d01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726069.471817:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eaa00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726069.471822:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1d01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726069.471843:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1d01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726069.471861:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a111639500) 00010000:00010000:0.0:1788726069.471864:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726069.471869:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1d01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726069.471876:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1d01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726069.471942:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914132352 00000100:00100000:3.0:1788726069.471951:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914132352 00000100:00100000:3.0:1788726069.472004:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:3.0:1788726069.472016:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914132352:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788726069.472288:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788726069.472291:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788726069 -> 1788726068 00002000:00010000:3.0:1788726069.472293:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788726066 00002000:00010000:3.0:1788726069.472294:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788726069 -> 1788726068 00002000:00010000:3.0:1788726069.472303:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788726069.472348:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2349:x1875614914132352:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 336us (638us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788726069.472353:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:1.0:1788726069.475261:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726069.475397:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914132608 00000100:00100000:2.0:1788726069.475407:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914132608 00000100:00100000:2.0:1788726069.475472:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 185 00000100:00100000:2.0:1788726069.475483:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:11488:x1875614914132608:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788726069.475557:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.475591:0:7629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a26b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.475600:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d08 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.475635:0:7629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a26b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.475649:0:7629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a26b expref: 18 pid: 5834 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726069.475664:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935099776:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788726069.475753:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13ad3b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726069.479653:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726069.479730:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914132736 00000100:00100000:3.0:1788726069.479741:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914132736 00010000:00010000:3.0:1788726069.479786:0:8495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cd0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a26b expref: 19 pid: 5834 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726069.479807:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935099776:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726069.479831:0:7629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726069.479835:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:3.0:1788726069.479852:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:2350:x1875614914132736:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726069.479866:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726069.479873:0:8495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a26b expref: 19 pid: 5834 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.479900:0:8495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a26b expref: 19 pid: 5834 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.479921:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1cd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a26b expref: 19 pid: 5834 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.479935:0:8495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a111639500) 00010000:00010000:3.0:1788726069.479941:0:8495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.479949:0:8495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.479957:0:8495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d08 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.479988:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788726069.480042:0:7629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.480051:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.480077:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.480093:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.480106:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.480111:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726069.480115:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.480123:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.480132:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a111639500) 00010000:00010000:2.0:1788726069.480134:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788726069.480138:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.480144:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726069.480873:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:2350:x1875614914132736:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 1021us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726069.480884:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 70 00000100:00100000:2.0:1788726069.480896:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:11488:x1875614914132608:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 5413us (5685us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788726069.480906:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 185 00000100:00100000:1.0:1788726069.484982:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726069.486257:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914132864 00000100:00100000:2.0:1788726069.486269:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914132864 00000100:00100000:2.0:1788726069.486381:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:2.0:1788726069.486393:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2349:x1875614914132864:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788726069.486439:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1d0f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.486460:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1cfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a287 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.486483:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726069.486487:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788726069.486492:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1d0f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.486528:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1cfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a287 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.486543:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1cfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a287 expref: 8 pid: 6683 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726069.486559:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a90bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875614935099904:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788726069.486641:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13ad3b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726069.491945:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726069.492056:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914132992 00000100:00100000:3.0:1788726069.492067:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914132992 00010000:00010000:3.0:1788726069.492120:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1cfa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a287 expref: 9 pid: 6683 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726069.492163:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:3.0:1788726069.492174:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2350:x1875614914132992:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726069.492207:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726069.492246:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1cfa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a287 expref: 9 pid: 6683 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.492261:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1cfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a287 expref: 9 pid: 6683 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.492287:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788726069.492292:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788726069.492298:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1d0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.492308:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1d0f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.492332:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726069.492395:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2350:x1875614914132992:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 223us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726069.492402:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 71 00010000:00010000:2.0:1788726069.493050:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1cfa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a287 expref: 8 pid: 6683 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726069.493070:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a90bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875614935099904:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726069.493105:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1d0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.493116:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1d0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.493123:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1d0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.493161:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1d0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.493169:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1d0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.493178:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1d0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.493185:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea200 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726069.493190:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1d0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.493199:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1d0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.493330:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1d0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.493339:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef5d7ecd/0xcbde9110e47c1d0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726069.493416:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914132864:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 7024us (8442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726069.493425:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:1.0:1788726069.495582:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726069.495665:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914133248 00000100:00100000:3.0:1788726069.495677:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914133248 00000100:00100000:3.0:1788726069.495742:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 186 00000100:00100000:3.0:1788726069.495753:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+17:11488:x1875614914133248:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788726069.495836:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1d16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.495853:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1d16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726069.498771:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1d16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.499449:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1d1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.499482:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1cde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a272 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.499493:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1d1d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.499536:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1cde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a272 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.499554:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1cde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a272 expref: 18 pid: 5834 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726069.499569:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935100032:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788726069.499752:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13ad3b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726069.508839:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935100032:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726069.508907:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1d1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726069.514462:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726069.515260:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914133376 00000100:00100000:2.0:1788726069.515271:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914133376 00010000:00010000:2.0:1788726069.515314:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1cde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a272 expref: 19 pid: 5834 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726069.515352:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:2.0:1788726069.515361:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:2350:x1875614914133376:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726069.515387:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726069.515393:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1cde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a272 expref: 19 pid: 5834 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.515406:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1cde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a272 expref: 19 pid: 5834 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.515429:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c1cde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a272 expref: 19 pid: 5834 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.515445:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a111639500) 00010000:00010000:2.0:1788726069.515450:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1d1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.515460:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1d1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.515468:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1d1d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.515497:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726069.515555:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:2350:x1875614914133376:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 194us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726069.515563:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 72 00010000:00010000:2.0:1788726069.515665:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1d1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.515673:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1d1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788726069.515875:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1788726069.515997:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1788726069.516033:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1788726069.516111:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875614935100160:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788726069.516171:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726069.516203:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13ad3bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726069.516996:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935100160 00000100:00100000:3.0:1788726069.517006:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935100160 00000100:00100000:3.0:1788726069.517094:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788726069.517104:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1875614935100160:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788726069.517197:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1875614935100160:12345-0@lo:1000:mdt00_001.0 Request processed in 96us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726069.517204:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788726069.518348:0:5835:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788726069.518358:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a1116a2300, transno 4294967315 00000100:00100000:1.0:1788726069.518377:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875614935100160:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788726069.519252:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788726069.519362:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875614935100288:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788726069.519416:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726069.519459:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935100288 00000100:00100000:1.0:1788726069.519471:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935100288 00000100:00100000:1.0:1788726069.519513:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788726069.519523:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1875614935100288:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788726069.519696:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1875614935100288:12345-0@lo:1000:mdt00_001.0 Request processed in 174us (278us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788726069.519704:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788726069.519732:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a141d6c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788726069.519754:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875614935100288:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788726069.519787:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1d1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519797:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1d1d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519805:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1d1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519811:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726069.519815:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1d1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519823:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1d1d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519840:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a111639500) 00010000:00010000:1.0:1788726069.519844:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788726069.519849:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1d1d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519855:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1d1d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519898:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1c59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519903:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1c59 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519909:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1c59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519913:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726069.519916:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1c59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519921:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1c59 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519929:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a111639000) 00010000:00010000:1.0:1788726069.519931:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788726069.519934:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1c59 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519938:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c1c59 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519959:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1d24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519972:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1c75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a256 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.519980:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1d24 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.520014:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1c75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a256 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.520027:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1c75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a256 expref: 21 pid: 5835 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726069.520039:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935100416:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788726069.520202:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a141d6c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788726069.533034:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935100416:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788726069.533082:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1d24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726069.540269:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726069.541014:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914133504 00000100:00100000:2.0:1788726069.541026:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914133504 00010000:00010000:2.0:1788726069.541070:0:8495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1c75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a256 expref: 22 pid: 5835 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726069.541123:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:2.0:1788726069.541134:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:2349:x1875614914133504:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726069.541150:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726069.541158:0:8495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1c75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a256 expref: 22 pid: 5835 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.541171:0:8495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1c75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a256 expref: 22 pid: 5835 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.541192:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c1c75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a256 expref: 22 pid: 5835 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.541210:0:8495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a111639000) 00010000:00010000:2.0:1788726069.541253:0:8495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1d24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.541283:0:8495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1d24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.541290:0:8495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1d24 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.541325:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726069.541384:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:2349:x1875614914133504:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 252us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726069.541392:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 73 00010000:00010000:1.0:1788726069.541600:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1d24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.541609:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1d24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.541621:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1d24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.541628:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1d24 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.541634:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1d24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.541640:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726069.541643:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1d24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.541657:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1d24 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.541668:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a111639000) 00010000:00010000:1.0:1788726069.541671:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726069.541675:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1d24 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.541681:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921800/0xcbde9110e47c1d24 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.541692:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1d16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.541698:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1d16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.541704:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1d16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.541709:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726069.541712:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1d16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.541717:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1d16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.541725:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a111639000) 00010000:00010000:1.0:1788726069.541727:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788726069.541730:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1d16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.541746:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c1d16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788726069.542146:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788726069.542153:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788726069.542650:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788726069.542660:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788726069.543075:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:11488:x1875614914133248:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 47319us (47495us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1788726069.543096:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 186 00000020:00080000:1.0:1788726069.543102:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788726069.547877:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726069.548060:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914133760 00000100:00100000:0.0:1788726069.548072:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914133760 00000100:00100000:0.0:1788726069.548148:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:0.0:1788726069.548159:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a103399850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:11488:x1875614914133760:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788726069.548991:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788726069.549082:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1788726069.549141:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1d2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.549158:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.549171:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.549180:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1d2b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.549187:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1d2b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.549193:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1d2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726069.552203:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788726069.552379:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a103399850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:11488:x1875614914133760:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 4216us (4506us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788726069.552407:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00000020:00080000:1.0:1788726069.552414:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788726069.552869:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726069.552878:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1d2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.552889:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921000 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726069.552893:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1d2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.552903:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1d2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.552921:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91a10d14d200) 00010000:00010000:2.0:1788726069.552923:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788726069.552928:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1d2b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.552946:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1d2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726069.552965:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726069.552967:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726069.552969:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788726070.160177:0:12399:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788726070.160186:0:12399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788726070.160268:0:12399:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788726070.160273:0:12399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788726070.181566:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726070.181607:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726070.181627:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726070.181642:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726070.181661:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726070.181761:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914133888 00000100:00100000:3.0:1788726070.181772:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914133888 00000100:00100000:3.0:1788726070.181831:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 293 00000100:00100000:3.0:1788726070.181841:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:2352:x1875614914133888:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726070.181908:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:2352:x1875614914133888:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 68us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726070.181916:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 293 00000100:00100000:3.0:1788726070.181947:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914134144 00000100:00100000:3.0:1788726070.181951:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914134144 00000100:00100000:3.0:1788726070.181985:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914134272 00000100:00100000:3.0:1788726070.181988:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914134272 00000100:00100000:3.0:1788726070.182005:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:3.0:1788726070.182011:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2352:x1875614914134144:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726070.182053:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2352:x1875614914134144:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 42us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726070.182060:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:3.0:1788726070.182088:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:3.0:1788726070.182095:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2352:x1875614914134272:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726070.182117:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2352:x1875614914134272:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726070.182123:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 90 00000100:00100000:3.0:1788726070.182138:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914134400 00000100:00100000:3.0:1788726070.182142:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914134400 00000100:00100000:3.0:1788726070.182164:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914134016 00000100:00100000:3.0:1788726070.182166:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914134016 00000100:00100000:3.0:1788726070.182185:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 148 00000100:00100000:3.0:1788726070.182190:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2352:x1875614914134400:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726070.182239:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2352:x1875614914134400:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 25us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726070.182245:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 148 00000100:00100000:3.0:1788726070.182256:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 149 00000100:00100000:3.0:1788726070.182262:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:2352:x1875614914134016:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726070.182299:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:2352:x1875614914134016:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 37us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726070.182305:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 149 00000100:00080000:3.0:1788726070.182426:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788726070.182431:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788726070.293733:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726070.342088:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726070.342172:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914134656 00000100:00100000:0.0:1788726070.342183:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914134656 00000100:00100000:0.0:1788726070.342362:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 187 00000100:00100000:0.0:1788726070.342380:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:11502:x1875614914134656:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726070.342401:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726070.342422:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1d32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a28e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.342518:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725400/0xcbde9110e47c1d39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.342533:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725400/0xcbde9110e47c1d39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.342544:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725400/0xcbde9110e47c1d39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726070.342555:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788726070.342682:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1d32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a28e expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.342699:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725400/0xcbde9110e47c1d39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a28e expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.342709:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:0.0:1788726070.342712:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788726070.342716:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725400, rc 0) 00000100:00100000:0.0:1788726070.342776:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:11502:x1875614914134656:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 398us (706us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788726070.342784:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 187 00000100:00100000:1.0:1788726070.352828:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726070.352869:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914134784 00000100:00100000:1.0:1788726070.352879:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914134784 00000100:00100000:1.0:1788726070.352935:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 188 00000100:00100000:1.0:1788726070.352945:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:11502:x1875614914134784:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:1.0:1788726070.353022:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1d47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353038:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353049:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353063:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921c00/0xcbde9110e47c1d4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353080:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921c00/0xcbde9110e47c1d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353088:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921c00/0xcbde9110e47c1d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353339:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1d55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353348:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353365:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788726070.353404:0:7629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353415:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353421:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1d47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353428:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1d47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353434:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726070.353438:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1d47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353446:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1d47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353457:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:1.0:1788726070.353460:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726070.353465:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1d47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353471:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c1d47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353482:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921c00/0xcbde9110e47c1d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353493:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921c00/0xcbde9110e47c1d4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353499:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921c00/0xcbde9110e47c1d4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353504:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726070.353507:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921c00/0xcbde9110e47c1d4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353513:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921c00/0xcbde9110e47c1d4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353520:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a10d14de00) 00010000:00010000:1.0:1788726070.353523:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726070.353525:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921c00/0xcbde9110e47c1d4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353531:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921c00/0xcbde9110e47c1d4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353544:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353550:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1d55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353556:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353560:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726070.353568:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353574:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1d55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353581:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a10d14da00) 00010000:00010000:1.0:1788726070.353584:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726070.353586:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1d55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.353592:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1d55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726070.353664:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:11502:x1875614914134784:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 719us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726070.353673:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 188 00000100:00100000:0.0:1788726070.435316:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726070.435423:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914135040 00000100:00100000:2.0:1788726070.435435:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914135040 00000100:00100000:2.0:1788726070.435520:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 189 00000100:00100000:2.0:1788726070.435532:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+24:11505:x1875614914135040:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726070.435554:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726070.435575:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1d5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a295 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.435654:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1d63 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.435670:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1d63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.435682:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1d63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.435698:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1d6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.435705:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.435727:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436003:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436012:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436020:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726070.436030:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788726070.436138:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1d63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436146:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1d63 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436152:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1d63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436158:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eba00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726070.436163:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1d63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436171:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1d63 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436183:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:2.0:1788726070.436186:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726070.436197:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1d63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436204:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1d63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436267:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436274:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1d6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436280:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1d6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436285:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ebe00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726070.436289:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1d6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436294:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1d6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436303:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a11214cf00) 00010000:00010000:2.0:1788726070.436305:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726070.436308:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1d6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436313:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1d6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436354:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c1d5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a295 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436382:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a295 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.436390:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a11214c000) 00010000:00010000:2.0:1788726070.436392:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726070.436395:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea200, rc 0) 00000100:00100000:2.0:1788726070.436458:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:11505:x1875614914135040:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 928us (1151us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788726070.436466:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 189 00000100:00100000:1.0:1788726070.440293:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726070.440420:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914135168 00000100:00100000:2.0:1788726070.440431:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914135168 00000100:00100000:2.0:1788726070.440490:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 190 00000100:00100000:2.0:1788726070.440501:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:11505:x1875614914135168:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:2.0:1788726070.440571:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.440587:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.440599:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.440627:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.440633:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.440659:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.440664:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eac00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726070.440668:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.440676:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.440688:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a11214c000) 00010000:00010000:2.0:1788726070.440692:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788726070.440696:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.440701:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726070.440862:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:11505:x1875614914135168:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 362us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726070.440870:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 190 00000100:00100000:3.0:1788726070.451469:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726070.451569:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914135424 00000100:00100000:0.0:1788726070.451585:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914135424 00000100:00100000:0.0:1788726070.451645:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:0.0:1788726070.451656:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:11505:x1875614914135424:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788726070.451901:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:11505:x1875614914135424:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 244us (440us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788726070.451909:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:3.0:1788726070.486498:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788726070.487759:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935100672:0@lo:400:kworker.0 00000100:00100000:0.0:1788726070.487835:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726070.487902:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788726070.487909:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935100800:0@lo:400:kworker.0 00000100:00100000:0.0:1788726070.487935:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726070.489658:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a869500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935100928:0@lo:400:kworker.0 00000100:00100000:3.0:1788726070.489725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726070.489768:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935100544:0@lo:400:kworker.0 00000100:00100000:3.0:1788726070.489801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726070.489848:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935100800 00000100:00100000:3.0:1788726070.489856:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935100800 00000100:00100000:3.0:1788726070.489923:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788726070.489933:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1875614935100800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726070.489994:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1875614935100800:12345-0@lo:400:kworker.0 Request processed in 62us (2057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726070.490002:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1788726070.490022:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788726070.490059:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935100800:0@lo:400:kworker.0 00000100:00100000:3.0:1788726070.490125:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935100672 00000100:00100000:3.0:1788726070.490129:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935100672 00000100:00100000:3.0:1788726070.490152:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935100928 00000100:00100000:3.0:1788726070.490155:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935100928 00000100:00100000:3.0:1788726070.490181:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788726070.490188:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935100672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726070.490261:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935100672:12345-0@lo:400:kworker.0 Request processed in 72us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726070.490267:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788726070.490279:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788726070.490286:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935100928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726070.490319:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935100928:12345-0@lo:400:kworker.0 Request processed in 34us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726070.490340:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1788726070.490356:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726070.490377:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935100672:0@lo:400:kworker.0 00000100:00100000:3.0:1788726070.490401:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a869500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935100928:0@lo:400:kworker.0 00000100:00100000:1.0:1788726070.490721:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935100544 00000100:00100000:1.0:1788726070.490727:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935100544 00000100:00100000:1.0:1788726070.490757:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788726070.490766:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935100544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726070.490825:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935100544:12345-0@lo:400:kworker.0 Request processed in 60us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726070.490832:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788726070.490926:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935100544:0@lo:400:kworker.0 00000100:00100000:0.0:1788726070.492681:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935101056:0@lo:400:kworker.0 00000100:00100000:0.0:1788726070.492749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726070.492908:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788726070.492922:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a869500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935101184:0@lo:400:kworker.0 00000100:00100000:1.0:1788726070.492956:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726070.493053:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935101056 00000100:00100000:3.0:1788726070.493076:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935101056 00000100:00100000:3.0:1788726070.493143:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788726070.493153:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935101056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726070.493236:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935101184 00000100:00100000:2.0:1788726070.493241:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935101184 00000100:00100000:2.0:1788726070.493270:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788726070.493277:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875614935101184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726070.493317:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875614935101184:12345-0@lo:400:kworker.0 Request processed in 40us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726070.493324:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788726070.493465:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726070.493498:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a869500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935101184:0@lo:400:kworker.0 00000100:00100000:3.0:1788726070.496782:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935101056:12345-0@lo:400:kworker.0 Request processed in 3621us (4022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726070.496798:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788726070.499918:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935101056:0@lo:400:kworker.0 00000100:00100000:0.0:1788726070.510353:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726070.510443:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914135680 00000100:00100000:3.0:1788726070.510452:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914135680 00000100:00100000:3.0:1788726070.510564:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 191 00000100:00100000:3.0:1788726070.510575:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:11039:x1875614914135680:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788726070.510598:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726070.510619:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1d86 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a29c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.510720:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.510734:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a295 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.510743:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.510789:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a295 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.510802:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a295 expref: 28 pid: 5835 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726070.510816:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875614935101312:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726070.510897:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13398f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726070.517888:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726070.518008:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914135808 00000100:00100000:1.0:1788726070.518018:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914135808 00010000:00010000:1.0:1788726070.518075:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d71 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a295 expref: 29 pid: 5835 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726070.518114:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:1.0:1788726070.518124:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a86a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:2349:x1875614914135808:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726070.518137:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726070.518143:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d71 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a295 expref: 29 pid: 5835 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.518157:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a295 expref: 29 pid: 5835 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.518178:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a11214c000) 00010000:00010000:1.0:1788726070.518183:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.518192:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.518199:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.518233:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726070.518287:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a86a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:2349:x1875614914135808:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 164us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726070.518294:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 74 00010000:00010000:3.0:1788726070.521674:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c1d71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a295 expref: 28 pid: 5835 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726070.521705:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875614935101312:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788726070.521731:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.521743:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.521750:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726070.521773:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788726070.521938:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914e00/0xcbde9110e47c1d86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a29c expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.521955:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a29c expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.521986:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a11214c000) 00010000:00010000:3.0:1788726070.521989:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788726070.521993:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914a00, rc 0) 00000100:00100000:3.0:1788726070.522443:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:11039:x1875614914135680:12345-192.168.201.42@tcp:101:bash.0 Request processed in 11869us (12098us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788726070.522453:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 191 00000100:00100000:2.0:1788726070.532451:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726070.536489:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914136064 00000100:00100000:3.0:1788726070.536508:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914136064 00000100:00100000:2.0:1788726070.539675:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 192 00000100:00100000:2.0:1788726070.539696:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:11039:x1875614914136064:12345-192.168.201.42@tcp:36:bash.0 00010000:00010000:2.0:1788726070.540002:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.540020:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.540031:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788726070.540128:0:7629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788726070.540155:0:7629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c3b825f reply state 00000000732fdc1e transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726070.540165:0:7629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788726070.540250:0:7629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788726070.540374:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+32:11039:x1875614914136064:12345-192.168.201.42@tcp:36:bash.0 Request processed in 682us (7931us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788726070.540382:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 192 00000020:00080000:2.0:1788726070.540387:0:7629:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788726070.548349:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726070.548440:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914136192 00000100:00100000:1.0:1788726070.548477:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914136192 00000100:00100000:1.0:1788726070.548541:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 193 00000100:00100000:1.0:1788726070.548551:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+32:11039:x1875614914136192:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788726070.548576:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726070.548598:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1da2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a2a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.548677:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1da2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2a3 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.548690:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1da2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2a3 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.548710:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a11214c000) 00010000:00010000:1.0:1788726070.548713:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788726070.548716:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920e00, rc 0) 00000100:00100000:1.0:1788726070.548778:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+33:11039:x1875614914136192:12345-192.168.201.42@tcp:101:bash.0 Request processed in 228us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726070.548785:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 193 00010000:00010000:3.0:1788726070.549139:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.549148:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d9b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.549154:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.549159:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eac00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726070.549164:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.549172:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d9b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.549185:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a11214c000) 00010000:00010000:3.0:1788726070.549187:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726070.549191:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d9b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.549208:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1d9b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726070.552206:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726070.552446:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914136320 00000100:00100000:3.0:1788726070.552467:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914136320 00000100:00100000:3.0:1788726070.552522:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:3.0:1788726070.552531:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:11039:x1875614914136320:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788726070.552551:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726070.552578:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0f9e0e8/0xcbde9110e47c1da9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a2aa expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726070.552605:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9dcb34, atime: 0x6a9dcb32, ctime: 0x6a9dcb34, blocks: 0xb 00010000:00010000:3.0:1788726070.552628:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1788726070.552633:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726070.552642:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f9e0e8/0xcbde9110e47c1da9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2aa expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.552669:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0f9e0e8/0xcbde9110e47c1da9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2aa expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.552684:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914e00, rc 0) 00000100:00100000:3.0:1788726070.552745:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:11039:x1875614914136320:12345-192.168.201.42@tcp:101:bash.0 Request processed in 214us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726070.552752:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:2.0:1788726070.560445:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726070.561878:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914136448 00000100:00100000:1.0:1788726070.561893:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914136448 00002000:00010000:1.0:1788726070.561943:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788726070.561947:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13ad52300 with x1875614914136448 ext(0->18446744073709551615) 00002000:00010000:1.0:1788726070.561960:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a13ad52300. 00000100:00100000:1.0:1788726070.562001:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:1.0:1788726070.562012:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2350:x1875614914136448:12345-192.168.201.42@tcp:10:bash.0 00002000:00010000:1.0:1788726070.562341:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788726070.562357:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788726068 -> 1788726070 00002000:00010000:1.0:1788726070.562359:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788726066 -> 1788726066 00002000:00010000:1.0:1788726070.562362:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788726068 -> 1788726070 00002000:00010000:1.0:1788726070.562364:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788726070.562423:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2350:x1875614914136448:12345-192.168.201.42@tcp:10:bash.0 Request processed in 412us (1988us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788726070.562432:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00002000:00010000:1.0:1788726070.562435:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788726070.562438:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13ad52300 with x1875614914136448 ext(0->18446744073709551615) 00002000:00010000:1.0:1788726070.562443:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a13ad52300. 00000100:00100000:0.0:1788726070.672141:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726070.672738:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914136576 00000100:00100000:3.0:1788726070.672752:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914136576 00000100:00100000:3.0:1788726070.672833:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 194 00000100:00100000:3.0:1788726070.672844:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+32:11519:x1875614914136576:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:3.0:1788726070.672927:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1db0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.672948:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1db0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.672962:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1db0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.672980:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1db7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673000:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673007:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673327:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1dbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673337:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673344:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788726070.673387:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673401:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1db0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673413:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1db0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673420:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1db0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673427:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726070.673431:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1db0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673438:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1db0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673450:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:3.0:1788726070.673453:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726070.673457:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1db0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673463:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1db0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673476:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673482:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1db7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673488:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1db7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673493:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726070.673504:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1db7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673511:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1db7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673519:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a111639400) 00010000:00010000:3.0:1788726070.673521:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726070.673524:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1db7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673530:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1db7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673546:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673551:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1dbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673557:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673561:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726070.673563:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673568:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1dbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673574:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a11214c000) 00010000:00010000:3.0:1788726070.673576:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726070.673584:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1dbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.673589:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1dbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726070.673674:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+32:11519:x1875614914136576:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 831us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726070.673683:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 194 00000100:00100000:0.0:1788726070.779736:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726070.780125:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914136832 00000100:00100000:3.0:1788726070.780136:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914136832 00000100:00100000:3.0:1788726070.780208:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 195 00000100:00100000:3.0:1788726070.780255:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+32:11522:x1875614914136832:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726070.780287:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726070.780489:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1dc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a2b1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.780642:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dcc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.780658:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.780669:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.780683:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1dd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.780691:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.780717:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.780981:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1dda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.780991:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.780999:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726070.781009:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788726070.781117:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.781126:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dcc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.781133:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.781140:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726070.781144:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.781153:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dcc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.781165:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:3.0:1788726070.781168:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726070.781179:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.781186:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.781200:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.781207:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1dd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.781213:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.781263:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726070.781267:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.783435:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1dd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.783464:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a111639400) 00010000:00010000:3.0:1788726070.783466:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726070.783472:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1dd3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.783479:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1dd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.783630:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1dc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2b1 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.783670:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1dda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2b1 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726070.783679:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a11214c000) 00010000:00010000:3.0:1788726070.783681:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788726070.783684:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914800, rc 0) 00000100:00100000:3.0:1788726070.783768:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+34:11522:x1875614914136832:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 3548us (4042us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788726070.783777:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 195 00000100:00100000:2.0:1788726070.794101:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726070.796769:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914136960 00000100:00100000:0.0:1788726070.796787:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914136960 00000100:00100000:0.0:1788726070.796872:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 196 00000100:00100000:0.0:1788726070.796883:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+34:11522:x1875614914136960:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:0.0:1788726070.796966:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1de8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.797004:0:7629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a29c expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.797013:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1de8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.797055:0:7629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a29c expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.797081:0:7629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a29c expref: 34 pid: 5834 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726070.797097:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a905500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935101440:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726070.797252:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a139cde600 going to sleep for 11 seconds 00000100:00100000:0.0:1788726070.804133:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726070.804205:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a905500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935101440:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726070.804255:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914137216 00000100:00100000:3.0:1788726070.804263:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914137216 00010000:00010000:2.0:1788726070.804297:0:7629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1de8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726070.804347:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:2.0:1788726070.804523:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:5591:x1875614914137216:12345-192.168.201.42@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788726070.804901:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+36:5591:x1875614914137216:12345-192.168.201.42@tcp:35:ldlm_bl.0 Request processed in 544us (777us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788726070.804911:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:1.0:1788726070.807813:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726070.807989:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914137344 00000100:00100000:2.0:1788726070.808000:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914137344 00010000:00010000:2.0:1788726070.808047:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a29c expref: 36 pid: 5834 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726070.808191:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:2.0:1788726070.808202:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+36:2349:x1875614914137344:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726070.808242:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726070.808256:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a29c expref: 36 pid: 5834 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.808269:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a29c expref: 36 pid: 5834 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.808292:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c1d8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a29c expref: 36 pid: 5834 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.808309:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a11214c000) 00010000:00010000:2.0:1788726070.808313:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1de8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.808327:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.808333:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1de8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726070.808915:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726070.808997:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:2349:x1875614914137344:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 794us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726070.809006:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 75 00010000:00010000:0.0:1788726070.811894:0:7629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.811916:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.811957:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.811966:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1de8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.811975:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1de8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.812515:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726070.812521:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1de8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.812529:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1de8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.812550:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a11214c000) 00010000:00010000:0.0:1788726070.812553:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788726070.812559:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1de8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.812566:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1de8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726070.812807:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+34:11522:x1875614914136960:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 15918us (18708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726070.812830:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 196 00000100:00100000:1.0:1788726070.832147:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726070.832260:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914137600 00000100:00100000:0.0:1788726070.832271:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914137600 00000100:00100000:0.0:1788726070.832335:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:0.0:1788726070.832347:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+34:11522:x1875614914137600:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:0.0:1788726070.832603:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:11522:x1875614914137600:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 258us (465us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788726070.832612:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:3.0:1788726070.998654:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788726071.008773:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935101568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788726071.008860:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726071.009126:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726071.010960:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935101568 00000100:00100000:2.0:1788726071.010975:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935101568 00000100:00100000:2.0:1788726071.011054:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788726071.011075:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875614935101568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788726071.011121:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788726071.011203:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875614935101568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (2342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726071.011211:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788726071.011404:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788726071.013034:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935101568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788726071.013091:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914137856 00000100:00100000:3.0:1788726071.013098:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914137856 00000100:00100000:3.0:1788726071.013158:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 197 00000100:00100000:3.0:1788726071.013168:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+35:11533:x1875614914137856:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:3.0:1788726071.013191:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726071.013239:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1def lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a2b8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013329:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1df6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013357:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013371:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013387:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013393:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013399:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013691:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1e04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013701:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013708:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726071.013719:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788726071.013827:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013834:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1df6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013840:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1df6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013851:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726071.013856:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1df6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013863:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1df6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013876:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:3.0:1788726071.013878:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726071.013883:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1df6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013889:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1df6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013901:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013906:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013911:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013915:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726071.013918:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013923:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013941:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a111639400) 00010000:00010000:3.0:1788726071.013943:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726071.013946:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013951:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1dfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.013992:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1def lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2b8 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.014007:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2b8 expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.014014:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a11214c000) 00010000:00010000:3.0:1788726071.014016:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726071.014018:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915800, rc 0) 00000100:00100000:3.0:1788726071.014098:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+37:11533:x1875614914137856:12345-192.168.201.42@tcp:101:cat.0 Request processed in 930us (4973us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788726071.014106:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 197 00000100:00100000:3.0:1788726071.028760:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726071.028919:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914138112 00000100:00100000:0.0:1788726071.028930:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914138112 00000100:00100000:0.0:1788726071.028991:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:0.0:1788726071.029014:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+37:11533:x1875614914138112:12345-192.168.201.42@tcp:35:cat.0 00000100:00100000:1.0:1788726071.040644:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+38:11533:x1875614914138112:12345-192.168.201.42@tcp:35:cat.0 Request processed in 11621us (11884us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788726071.040658:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:1.0:1788726071.079535:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726071.080482:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914138368 00000100:00100000:3.0:1788726071.080492:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914138368 00000100:00100000:2.0:1788726071.080693:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 198 00000100:00100000:2.0:1788726071.080705:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+38:11534:x1875614914138368:12345-192.168.201.42@tcp:36:rm.0 00010000:00010000:2.0:1788726071.080829:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788726071.080856:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c1e04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2b8 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.080881:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1dda lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2b1 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.080894:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920e00/0xcbde9110e47c1da2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2a3 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.080904:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a11214c000) 00010000:00010000:2.0:1788726071.080925:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788726071.080945:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1e12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.080958:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1e12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.080967:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1e12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.080979:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1e19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.080986:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1e19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.080992:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1e19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.082035:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1e20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.082050:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1e20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.082067:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1e20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788726071.082620:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788726071.082630:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366132414130ns, next at 367132411842ns, rc = 0 00010000:00010000:2.0:1788726071.082687:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1e27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.082709:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.082717:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.082724:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1e27 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.082730:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1e27 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.084966:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1e27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.085008:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726071.085038:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1e20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.085044:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1e20 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.085050:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1e20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.085065:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726071.085070:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1e20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.085077:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1e20 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.085116:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a11214c300) 00010000:00010000:2.0:1788726071.085130:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788726071.085135:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1e20 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.085142:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1e20 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.085168:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1e12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.085174:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1e12 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.085180:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1e12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.085184:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eaa00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726071.085187:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1e12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.085193:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1e12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.085202:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:2.0:1788726071.085205:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726071.085207:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1e12 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.085213:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c1e12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788726071.085265:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000395529e9 reply state 000000002123cb78 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1e19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726071.085664:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788726071.085826:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+37:11534:x1875614914138368:12345-192.168.201.42@tcp:36:rm.0 Request processed in 5118us (6295us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788726071.085835:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 198 00010000:00010000:3.0:1788726071.085920:0:8494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726071.085927:0:8494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1e27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.085934:0:8494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:3.0:1788726071.085945:0:8494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1e27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.085952:0:8494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1e27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.085962:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91a11214c300) 00010000:00010000:3.0:1788726071.085965:0:8494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788726071.085968:0:8494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1e27 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.085974:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1e27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.085989:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726071.085991:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726071.085993:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726071.087751:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1e19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.087766:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1e19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.087774:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1e19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.087780:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eae00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726071.087784:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1e19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.087792:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1e19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.087806:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a11214cf00) 00010000:00010000:0.0:1788726071.087809:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726071.087812:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1e19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.087818:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eae00/0xcbde9110e47c1e19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726071.160415:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726071.160608:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914138624 00000100:00100000:3.0:1788726071.160619:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914138624 00000100:00100000:3.0:1788726071.160684:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 199 00000100:00100000:3.0:1788726071.160695:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+36:11540:x1875614914138624:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788726071.160721:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726071.160741:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1e2e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a2bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.160861:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.160877:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.160888:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.160919:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1e3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.160929:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.160934:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788726071.163645:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788726071.163897:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1e43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.163914:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.163927:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.163968:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.163975:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e35 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.163982:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.163988:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726071.163992:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.166148:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.166169:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:3.0:1788726071.166172:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726071.166177:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.166185:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788726071.166206:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008debb5d5 reply state 00000000ea471d07 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726071.166258:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788726071.167687:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1e2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2bf expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.167718:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2bf expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.167727:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639900) 00010000:00010000:3.0:1788726071.167730:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726071.167733:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915400, rc 0) 00000100:00100000:3.0:1788726071.167948:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+39:11540:x1875614914138624:12345-192.168.201.42@tcp:101:bash.0 Request processed in 7252us (7540us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788726071.167957:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 199 00000100:00100000:2.0:1788726071.188617:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726071.188699:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914138752 00000100:00100000:0.0:1788726071.188710:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914138752 00000100:00100000:0.0:1788726071.188775:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:0.0:1788726071.188786:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2351:x1875614914138752:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788726071.188807:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726071.188844:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a2c6 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726071.188874:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726071.188894:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1788726071.188898:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726071.188907:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2c6 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.188926:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2c6 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.188940:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725e00, rc 0) 00010000:00010000:3.0:1788726071.189128:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.189143:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1e3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.189151:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1e3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.189157:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726071.189162:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1e3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.189169:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1e3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.189182:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a111639400) 00010000:00010000:3.0:1788726071.189185:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726071.189190:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1e3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.189196:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1e3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726071.190032:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2351:x1875614914138752:12345-192.168.201.42@tcp:101:bash.0 Request processed in 1242us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726071.190041:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:0.0:1788726071.195692:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726071.195764:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914138880 00000100:00100000:3.0:1788726071.195774:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914138880 00000100:00100000:3.0:1788726071.195826:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:3.0:1788726071.195836:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:11540:x1875614914138880:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788726071.195852:0:9742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726071.195867:0:9742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a2cd expref: -99 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.195912:0:9742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e51 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2c6 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.195921:0:9742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726071.195925:0:9742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726071.195931:0:9742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 7 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.195961:0:9742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2c6 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.195974:0:9742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2c6 expref: 7 pid: 6680 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726071.195987:0:9742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9742:1875614935101696:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726071.196083:0:9742:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a141d6c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726071.200794:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726071.200836:0:9742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9742:1875614935101696:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788726071.200873:0:9742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 7 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.200895:0:9742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915200, rc 0) 00000100:00100000:3.0:1788726071.200956:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:11540:x1875614914138880:12345-192.168.201.42@tcp:101:bash.0 Request processed in 5121us (5273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726071.200965:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:2.0:1788726071.205403:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914139008 00000100:00100000:2.0:1788726071.205420:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914139008 00010000:00010000:2.0:1788726071.205474:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2c6 expref: 7 pid: 6680 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726071.205527:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:2.0:1788726071.205547:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1128e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2350:x1875614914139008:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726071.205563:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726071.205589:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2c6 expref: 7 pid: 6680 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.205603:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2c6 expref: 7 pid: 6680 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.205626:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2c6 expref: 7 pid: 6680 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.205641:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726071.205659:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726071.205668:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 6 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.205677:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 6 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.205720:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 6 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726071.205735:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875614935101824:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788726071.205829:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13aed0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788726071.209870:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875614935101824:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788726071.209898:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726071.209965:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1128e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2350:x1875614914139008:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 4428us (9182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726071.209976:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:3.0:1788726071.212039:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726071.212499:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914139264 00000100:00100000:2.0:1788726071.212509:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914139264 00000100:00100000:2.0:1788726071.212569:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:2.0:1788726071.212578:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+38:11540:x1875614914139264:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:2.0:1788726071.213619:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+39:11540:x1875614914139264:12345-192.168.201.42@tcp:35:bash.0 Request processed in 333us (880us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788726071.213634:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 55 00010000:00010000:2.0:1788726071.318469:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726071.412540:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726071.412630:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914139392 00000100:00100000:2.0:1788726071.412652:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914139392 00000100:00100000:2.0:1788726071.412712:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 200 00000100:00100000:2.0:1788726071.412723:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+39:11557:x1875614914139392:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726071.412746:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726071.412765:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1e5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a2d4 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.412822:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1e66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.412834:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.412846:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726071.412876:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788726071.412879:0:7629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726071.412894:0:7629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.412916:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1e5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2d4 expref: 41 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.412934:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2d4 expref: 40 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.412943:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:2.0:1788726071.412945:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788726071.412949:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea600, rc 0) 00000100:00100000:2.0:1788726071.413011:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+40:11557:x1875614914139392:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 290us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726071.413018:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 200 00000100:00100000:1.0:1788726071.419726:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726071.419825:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914139648 00000100:00100000:0.0:1788726071.419835:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914139648 00000100:00100000:0.0:1788726071.419894:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 201 00000100:00100000:0.0:1788726071.419904:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+40:11557:x1875614914139648:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726071.419926:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726071.419948:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1e6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a2db expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.420131:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1e74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.420157:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.420168:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726071.420180:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788726071.420348:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1e6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2db expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.420521:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2db expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.420530:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639900) 00010000:00010000:0.0:1788726071.420533:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788726071.420537:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725000, rc 0) 00000100:00100000:0.0:1788726071.420605:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+42:11557:x1875614914139648:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 702us (888us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788726071.420612:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 201 00000100:00100000:3.0:1788726071.425711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726071.425816:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914139904 00000100:00100000:2.0:1788726071.425827:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914139904 00000100:00100000:2.0:1788726071.425880:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 202 00000100:00100000:2.0:1788726071.425890:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+42:11557:x1875614914139904:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726071.425914:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726071.425933:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1e82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a2e2 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.426018:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1e89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.426033:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1e89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.426044:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1e89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726071.426068:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788726071.426192:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1e82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2e2 expref: 45 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.426209:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1e89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2e2 expref: 44 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.426253:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639900) 00010000:00010000:2.0:1788726071.426256:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788726071.426283:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eb000, rc 0) 00000100:00100000:2.0:1788726071.426347:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+44:11557:x1875614914139904:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 458us (647us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788726071.426354:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 202 00000100:00100000:1.0:1788726071.434263:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726071.434323:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726071.434518:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914140160 00000100:00100000:0.0:1788726071.434528:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914140160 00000100:00100000:0.0:1788726071.434580:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:0.0:1788726071.434590:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+6:2349:x1875614914140160:12345-192.168.201.42@tcp:1:lfs.0 00010000:00010000:0.0:1788726071.434632:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.434654:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 6 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.434678:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726071.434683:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788726071.434688:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e97 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.434725:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 6 pid: 9742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.434739:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 6 pid: 9742 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726071.434754:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a907480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875614935101952:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726071.434833:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a139cde300 going to sleep for 11 seconds 00000100:00100000:3.0:1788726071.434918:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914140032 00000100:00100000:3.0:1788726071.434924:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914140032 00000100:00100000:3.0:1788726071.434969:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:3.0:1788726071.434976:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+44:2350:x1875614914140032:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726071.434987:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726071.435008:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1e74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2db expref: 44 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.435026:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639900) 00010000:00010000:3.0:1788726071.435030:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726071.435066:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+43:2350:x1875614914140032:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 90us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726071.435074:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:1.0:1788726071.438689:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726071.438801:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a907480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875614935101952:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726071.438829:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726071.439199:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914140288 00000100:00100000:3.0:1788726071.439208:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914140288 00002000:00100000:3.0:1788726071.439316:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff91a13b15ad80 x1875614914140288/t0(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:467/0 lens 504/0 e 0 to 0 dl 1788726082 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788726071.439327:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13b15ad80 with x1875614914140288 ext(0->8) 00010000:00010000:3.0:1788726071.439335:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 7 pid: 9742 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.439348:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 7 pid: 9742 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726071.439545:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91a13b15ad80 00000100:00100000:3.0:1788726071.439585:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:3.0:1788726071.439595:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2352:x1875614914140288:12345-192.168.201.42@tcp:4:lfs.0 00000100:00100000:3.0:1788726071.440168:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2352:x1875614914140288:12345-192.168.201.42@tcp:4:lfs.0 Request processed in 573us (1489us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788726071.440177:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00002000:00100000:3.0:1788726071.440185:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff91a13b15ad80 x1875614914140288/t4294967308(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:467/0 lens 504/448 e 0 to 0 dl 1788726082 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788726071.440193:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13b15ad80 with x1875614914140288 ext(0->8) 00010000:00010000:3.0:1788726071.440200:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 9 pid: 9742 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.440248:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 9 pid: 9742 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726071.440257:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91a13b15ad80 00000100:00100000:0.0:1788726071.443952:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726071.444064:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914140416 00000100:00100000:2.0:1788726071.444075:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914140416 00010000:00010000:2.0:1788726071.444112:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 9 pid: 9742 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726071.444206:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:2.0:1788726071.444256:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a907480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2349:x1875614914140416:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726071.444280:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788726071.444300:0:5818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788726071.444314:0:5818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788726071 00002000:00010000:2.0:1788726071.444317:0:5818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788726071 00002000:00010000:2.0:1788726071.444319:0:5818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788726071 00010000:00010000:2.0:1788726071.444326:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 9 pid: 9742 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.444342:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 9 pid: 9742 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.444621:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007b43338/0xcbde9110e47c1e58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2cd expref: 9 pid: 9742 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.444639:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788726071.444643:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788726071.444665:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.444675:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e97 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.444708:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726071.444773:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a907480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2349:x1875614914140416:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 557us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726071.444782:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 77 00010000:00010000:0.0:1788726071.444982:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.444993:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.445031:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.445041:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.445050:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.445068:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725e00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:0.0:1788726071.445072:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.445081:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.445092:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.445099:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea35bab7/0xcbde9110e47c1e97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726071.445159:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914140160:12345-192.168.201.42@tcp:1:lfs.0 Request processed in 10570us (10835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726071.445166:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:0.0:1788726071.449370:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726071.449488:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914140672 00000100:00100000:3.0:1788726071.449499:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914140672 00000100:00100000:3.0:1788726071.449555:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:3.0:1788726071.449565:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a10339b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+43:11557:x1875614914140672:12345-192.168.201.42@tcp:35:lfs.0 00000004:00010000:3.0:1788726071.449622:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1e89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2e2 expref: 43 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788726071.449890:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788726071.449930:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788726071.450266:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788726071.450326:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.450348:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1e43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2bf expref: 47 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.450357:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e9e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.450393:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2bf expref: 47 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.450407:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1e43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2bf expref: 47 pid: 5836 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726071.450422:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1875614935102080:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726071.450498:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a141d6c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726071.454929:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726071.454985:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914140800 00000100:00100000:2.0:1788726071.454994:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914140800 00010000:00010000:2.0:1788726071.455032:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1e43 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2bf expref: 48 pid: 5836 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726071.455082:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:2.0:1788726071.455092:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a905f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+48:2350:x1875614914140800:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726071.455107:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726071.455113:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1e43 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2bf expref: 48 pid: 5836 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.455127:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1e43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2bf expref: 48 pid: 5836 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.455148:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639900) 00010000:00010000:2.0:1788726071.455152:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.455177:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.455184:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e9e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.455202:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726071.455291:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a905f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+48:2350:x1875614914140800:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 199us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726071.455299:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 78 00010000:00010000:3.0:1788726071.456329:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1e43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2bf expref: 47 pid: 5836 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726071.456348:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1875614935102080:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788726071.456370:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.456380:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.456386:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788726071.456505:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788726071.456709:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1788726071.456818:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875614935102208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788726071.456875:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726071.456916:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a141d6ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788726071.457130:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935102208 00000100:00100000:1.0:1788726071.457137:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935102208 00000100:00100000:1.0:1788726071.457195:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788726071.457212:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5837:x1875614935102208:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788726071.457344:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5837:x1875614935102208:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 133us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726071.457352:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788726071.457762:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875614935102208:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788726071.458189:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788726071.458284:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875614935102336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788726071.458631:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726071.458652:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a141d6c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726071.458711:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935102336 00000100:00100000:1.0:1788726071.458718:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935102336 00000100:00100000:1.0:1788726071.458761:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788726071.458769:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5837:x1875614935102336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788726071.458937:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5837:x1875614935102336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 168us (306us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788726071.458945:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788726071.459038:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875614935102336:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788726071.459093:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1788726071.459129:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.459139:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e9e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.459147:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.459153:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726071.459158:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.459166:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e9e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.459183:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639900) 00010000:00010000:3.0:1788726071.459186:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788726071.459199:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e9e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.459206:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1e9e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788726071.460031:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788726071.460152:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1788726071.460162:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366509945950ns, next at 367509943980ns, rc = 0 00000001:00080000:3.0:1788726071.460170:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1788726071.460210:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639900) 00010000:00010000:3.0:1788726071.460244:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788726071.460252:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1e89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2e2 expref: 51 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726071.460377:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a10339b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+50:11557:x1875614914140672:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 10813us (11016us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1788726071.460387:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 56 00000020:00080000:3.0:1788726071.460391:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788726071.462865:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726071.462984:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914140928 00000100:00100000:3.0:1788726071.462995:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914140928 00000100:00100000:3.0:1788726071.463068:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 203 00000100:00100000:3.0:1788726071.463079:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+50:11557:x1875614914140928:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726071.463102:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726071.463124:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1ea5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a2e9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.463186:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2e9 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.463386:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2e9 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.463410:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:3.0:1788726071.463413:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788726071.463417:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915c00, rc 0) 00000100:00100000:3.0:1788726071.463480:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+51:11557:x1875614914140928:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 402us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726071.463487:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 203 00000100:00100000:0.0:1788726071.467552:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726071.467627:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914141184 00000100:00100000:2.0:1788726071.467636:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914141184 00000100:00100000:2.0:1788726071.467695:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:2.0:1788726071.467707:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+51:11557:x1875614914141184:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:2.0:1788726071.467964:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+52:11557:x1875614914141184:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 259us (420us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788726071.467973:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:0.0:1788726071.569503:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726071.569616:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914141312 00000100:00100000:2.0:1788726071.569626:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914141312 00000100:00100000:2.0:1788726071.569685:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 204 00000100:00100000:2.0:1788726071.569696:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+52:11567:x1875614914141312:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:2.0:1788726071.569777:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1eac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.569796:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1eac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.569807:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1eac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.569836:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1eb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.569845:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.569852:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.569938:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1eba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.569946:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.569953:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788726071.569995:0:7629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570008:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1eac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570013:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1eac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570020:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1eac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570025:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726071.570030:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1eac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570044:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1eac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570065:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:2.0:1788726071.570069:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726071.570074:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1eac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570080:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c1eac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570095:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570101:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1eb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570106:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570111:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726071.570114:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570119:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570126:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a11214c000) 00010000:00010000:2.0:1788726071.570129:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726071.570131:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1eb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570147:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1eb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570163:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570169:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1eba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570176:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1eba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570181:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726071.570185:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1eba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570191:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1eba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570199:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:2.0:1788726071.570202:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726071.570205:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1eba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.570211:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1eba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726071.570586:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+52:11567:x1875614914141312:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 891us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726071.570595:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 204 00000100:00100000:0.0:1788726071.614568:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726071.614832:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914141568 00000100:00100000:3.0:1788726071.614843:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914141568 00000100:00100000:3.0:1788726071.614906:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 205 00000100:00100000:3.0:1788726071.614917:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+52:11570:x1875614914141568:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726071.614940:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726071.614960:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1ec1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a2f0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615038:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ec8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615062:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615077:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615093:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1ecf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615112:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615119:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615287:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1ed6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615296:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615504:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726071.615519:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788726071.615627:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615636:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ec8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615643:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615649:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726071.615653:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615660:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ec8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615684:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:3.0:1788726071.615687:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726071.615693:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ec8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615699:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ec8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615713:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615719:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1ecf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615724:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615729:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726071.615732:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615738:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1ecf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615745:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a111639900) 00010000:00010000:3.0:1788726071.615747:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726071.615750:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1ecf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615756:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1ecf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615815:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1ec1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f0 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615829:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f0 expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.615836:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:3.0:1788726071.615838:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726071.615841:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915200, rc 0) 00000100:00100000:3.0:1788726071.615962:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+54:11570:x1875614914141568:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1046us (1403us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788726071.615969:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 205 00000100:00100000:0.0:1788726071.620538:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726071.620622:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914141696 00000100:00100000:2.0:1788726071.620633:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914141696 00000100:00100000:2.0:1788726071.620694:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 206 00000100:00100000:2.0:1788726071.620705:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+54:11570:x1875614914141696:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:2.0:1788726071.620770:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1ee4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.620788:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.620800:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.620823:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.620831:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1ee4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.620839:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.620845:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726071.620849:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.620857:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.620868:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:2.0:1788726071.620871:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788726071.620875:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1ee4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.620894:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c1ee4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726071.620966:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+54:11570:x1875614914141696:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 263us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726071.620974:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 206 00000100:00100000:3.0:1788726071.623046:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726071.623187:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914141952 00000100:00100000:2.0:1788726071.623198:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914141952 00000100:00100000:2.0:1788726071.623283:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:2.0:1788726071.623293:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+54:11570:x1875614914141952:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:2.0:1788726071.623541:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:11570:x1875614914141952:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 248us (501us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788726071.623549:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:3.0:1788726071.709205:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726071.709406:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914142208 00000100:00100000:0.0:1788726071.709417:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914142208 00000100:00100000:0.0:1788726071.709482:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 207 00000100:00100000:0.0:1788726071.709493:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:11580:x1875614914142208:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788726071.709520:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726071.709523:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788726071.709549:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c1e66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2d4 expref: 55 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.709569:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:0.0:1788726071.709573:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788726071.709587:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1eeb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a2f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.709691:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.709706:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1ed6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f0 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.709714:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.709762:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f0 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.709775:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f0 expref: 55 pid: 5836 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726071.709789:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a906300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875614935102464:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726071.709937:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a139cde300 going to sleep for 11 seconds 00000100:00100000:3.0:1788726071.716883:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a906300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875614935102464:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788726071.716913:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726071.724142:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726071.724255:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914142336 00000100:00100000:0.0:1788726071.724271:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914142336 00010000:00010000:0.0:1788726071.724324:0:8495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f0 expref: 56 pid: 5836 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726071.724369:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:0.0:1788726071.724380:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+56:2350:x1875614914142336:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726071.724394:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726071.724403:0:8495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f0 expref: 56 pid: 5836 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.724416:0:8495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f0 expref: 56 pid: 5836 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.724438:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915200/0xcbde9110e47c1ed6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f0 expref: 56 pid: 5836 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.724457:0:8495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:0.0:1788726071.724478:0:8495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.724487:0:8495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.724495:0:8495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.724528:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726071.724591:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:2350:x1875614914142336:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 213us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726071.724599:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 79 00010000:00010000:3.0:1788726071.724933:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.724941:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726071.724961:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788726071.725127:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1eeb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f7 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.725157:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f7 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.725165:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:3.0:1788726071.725168:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788726071.725171:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724c00, rc 0) 00000100:00100000:3.0:1788726071.725206:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:11580:x1875614914142208:12345-192.168.201.42@tcp:101:bash.0 Request processed in 15715us (16011us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788726071.725290:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 207 00000100:00100000:0.0:1788726071.728908:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726071.729002:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914142592 00000100:00100000:2.0:1788726071.729013:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914142592 00000100:00100000:2.0:1788726071.729081:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 208 00000100:00100000:2.0:1788726071.729092:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+55:11580:x1875614914142592:12345-192.168.201.42@tcp:36:bash.0 00010000:00010000:2.0:1788726071.729601:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1f00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.729619:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1f00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.729630:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1f00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788726071.729682:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788726071.729722:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004124093b reply state 0000000089e0d43b transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1f00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726071.729732:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788726071.729821:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+58:11580:x1875614914142592:12345-192.168.201.42@tcp:36:bash.0 Request processed in 729us (922us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788726071.729829:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 208 00000020:00080000:2.0:1788726071.729834:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788726071.733904:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726071.734004:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914142720 00000100:00100000:1.0:1788726071.734015:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914142720 00000100:00100000:1.0:1788726071.734087:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 209 00000100:00100000:1.0:1788726071.734098:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+58:11580:x1875614914142720:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788726071.734124:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726071.734145:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1f07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a2fe expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726071.734276:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726071.734292:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f7 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726071.734301:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1f00 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726071.734538:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726071.734556:0:5836:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1f00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726071.734582:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f7 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726071.734597:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f7 expref: 59 pid: 5834 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726071.734611:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b15a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875614935102592:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788726071.734747:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1070e50c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788726071.735625:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1f00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.735639:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1f00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.735647:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1f00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.735653:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726071.735657:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1f00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.735664:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1f00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.735680:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:0.0:1788726071.735683:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726071.735698:0:3290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.735708:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1f00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.735715:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb000/0xcbde9110e47c1f00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726071.738902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726071.738973:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914142848 00000100:00100000:0.0:1788726071.738984:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914142848 00010000:00010000:0.0:1788726071.739027:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f7 expref: 59 pid: 5834 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726071.739077:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:0.0:1788726071.739087:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+59:2349:x1875614914142848:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726071.739101:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726071.739109:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f7 expref: 59 pid: 5834 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.739122:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f7 expref: 59 pid: 5834 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.739144:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:0.0:1788726071.739149:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.739159:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.739165:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.739201:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726071.739618:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+59:2349:x1875614914142848:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 531us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726071.739628:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 80 00010000:00010000:1.0:1788726071.739715:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724c00/0xcbde9110e47c1ef2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2f7 expref: 58 pid: 5834 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726071.739733:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b15a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875614935102592:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788726071.739755:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726071.739765:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726071.739771:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726071.739814:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788726071.739825:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788726071.739848:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726071.739880:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c1f07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2fe expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726071.739896:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2fe expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726071.739904:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:1.0:1788726071.739907:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788726071.739910:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920200, rc 0) 00000100:00100000:1.0:1788726071.739936:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+57:11580:x1875614914142720:12345-192.168.201.42@tcp:101:bash.0 Request processed in 5840us (6043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726071.739943:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 209 00000100:00100000:2.0:1788726071.743855:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726071.743944:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914143104 00000100:00100000:0.0:1788726071.743956:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914143104 00000100:00100000:0.0:1788726071.744018:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:0.0:1788726071.744029:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+57:11580:x1875614914143104:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:0.0:1788726071.744331:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+58:11580:x1875614914143104:12345-192.168.201.42@tcp:35:bash.0 Request processed in 303us (485us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788726071.744339:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:2.0:1788726071.814626:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726071.814721:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914143232 00000100:00100000:0.0:1788726071.814731:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914143232 00000100:00100000:0.0:1788726071.814790:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 210 00000100:00100000:0.0:1788726071.814801:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+58:11586:x1875614914143232:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726071.814826:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726071.814848:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a305 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.814926:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1f1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.814942:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.814955:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726071.815010:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788726071.815014:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788726071.815033:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.815069:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a305 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.815088:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1f1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a305 expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.815098:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:0.0:1788726071.815101:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788726071.815104:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725000, rc 0) 00000100:00100000:0.0:1788726071.815168:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+59:11586:x1875614914143232:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 368us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726071.815176:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 210 00000100:00100000:2.0:1788726071.822660:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726071.822749:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914143360 00000100:00100000:3.0:1788726071.822758:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914143360 00000100:00100000:3.0:1788726071.822822:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 211 00000100:00100000:3.0:1788726071.822833:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+59:11586:x1875614914143360:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726071.822854:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726071.822873:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1f23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a30c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.822947:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1f2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.822962:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1f2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.822974:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1f2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823008:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1f31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823016:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823023:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823123:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1f38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823132:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823140:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726071.823175:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788726071.823179:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788726071.823197:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823210:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823902:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1f2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823910:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1f2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823932:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1f2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823938:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726071.823943:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1f2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823951:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1f2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823964:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:3.0:1788726071.823967:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726071.823971:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1f2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823978:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c1f2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823992:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.823999:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1f31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.824005:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.824010:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726071.824013:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.824028:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1f31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.824037:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a111639900) 00010000:00010000:3.0:1788726071.824039:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726071.824042:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1f31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.824061:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1f31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.824101:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914200/0xcbde9110e47c1f23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a30c expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.824115:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1f38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a30c expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.824123:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:3.0:1788726071.824125:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726071.824128:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914800, rc 0) 00000100:00100000:3.0:1788726071.824281:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+60:11586:x1875614914143360:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1449us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726071.824291:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 211 00000100:00100000:3.0:1788726071.828889:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726071.828965:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726071.829035:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914143744 00000100:00100000:1.0:1788726071.829054:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914143744 00000100:00100000:1.0:1788726071.829120:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:1.0:1788726071.829130:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+60:2349:x1875614914143744:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726071.829145:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726071.829170:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914800/0xcbde9110e47c1f38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a30c expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726071.829189:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:1.0:1788726071.829194:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726071.829447:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+59:2349:x1875614914143744:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 317us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726071.829473:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:0.0:1788726071.831828:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914143616 00000100:00100000:0.0:1788726071.831843:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914143616 00000100:00100000:0.0:1788726071.831968:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 212 00000100:00100000:0.0:1788726071.831980:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+59:11586:x1875614914143616:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726071.832000:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726071.832022:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a313 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.832142:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.832176:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2fe expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.832186:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.832246:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2fe expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.832272:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2fe expref: 60 pid: 5836 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726071.832286:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a905180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935102720:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726071.832646:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a139cde900 going to sleep for 11 seconds 00000100:00100000:0.0:1788726071.836034:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726071.836117:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914143872 00000100:00100000:3.0:1788726071.836127:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914143872 00010000:00010000:3.0:1788726071.836166:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2fe expref: 61 pid: 5836 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726071.836241:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:3.0:1788726071.836252:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1128e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+61:2350:x1875614914143872:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726071.836278:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726071.836286:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2fe expref: 61 pid: 5836 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.836300:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2fe expref: 61 pid: 5836 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.836333:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:3.0:1788726071.836338:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.836348:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.836356:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726071.836375:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726071.836422:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1128e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+61:2350:x1875614914143872:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 170us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726071.836429:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 81 00010000:00010000:2.0:1788726071.837775:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920200/0xcbde9110e47c1f0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2fe expref: 60 pid: 5836 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726071.837798:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a905180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935102720:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726071.837823:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.837835:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.837842:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726071.837860:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788726071.838011:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a313 expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.838028:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a313 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.838058:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:2.0:1788726071.838061:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788726071.838064:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725e00, rc 0) 00000100:00100000:2.0:1788726071.838124:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+60:11586:x1875614914143616:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 6146us (9243us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788726071.838133:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 212 00000100:00100000:0.0:1788726071.841650:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726071.841759:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914144128 00000100:00100000:2.0:1788726071.841770:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914144128 00000100:00100000:2.0:1788726071.841824:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:2.0:1788726071.841834:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a906a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+60:11586:x1875614914144128:12345-192.168.201.42@tcp:103:lfs.0 00010000:00010000:2.0:1788726071.841849:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726071.841874:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915c00/0xcbde9110e47c1ea5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2e9 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.841893:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:2.0:1788726071.841899:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726071.841964:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a906a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+59:11586:x1875614914144128:12345-192.168.201.42@tcp:103:lfs.0 Request processed in 131us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726071.841972:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:3.0:1788726071.844987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726071.845097:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914144256 00000100:00100000:0.0:1788726071.845106:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914144256 00000100:00100000:0.0:1788726071.845165:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 213 00000100:00100000:0.0:1788726071.845175:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+59:11586:x1875614914144256:12345-192.168.201.42@tcp:58:lfs.0 00010000:00010000:0.0:1788726071.845351:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1f54 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.845369:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1f54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726071.845381:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1f54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788726071.845575:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788726071.845652:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+59:11586:x1875614914144256:12345-192.168.201.42@tcp:58:lfs.0 Request processed in 477us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726071.845659:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 213 00000100:00100000:3.0:1788726071.850098:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726071.850185:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914144384 00000100:00100000:2.0:1788726071.850196:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914144384 00000100:00100000:2.0:1788726071.850287:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 214 00000100:00100000:2.0:1788726071.850298:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+59:11586:x1875614914144384:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726071.850430:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726071.850451:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1f5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a31a expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.850527:0:7629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1f54 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.850538:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1f5b lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a31a expref: 60 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.850557:0:7629:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1f54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.850570:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1f5b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a31a expref: 60 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.850584:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:2.0:1788726071.850587:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788726071.850591:0:7629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1f5b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a31a expref: 60 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726071.850598:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea400, rc 0) 00000100:00100000:2.0:1788726071.850664:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+60:11586:x1875614914144384:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 367us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726071.850671:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 214 00000100:00100000:2.0:1788726072.022076:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788726072.022097:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935102848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788726072.022169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726072.022272:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935102848 00000100:00100000:2.0:1788726072.022279:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935102848 00000100:00100000:2.0:1788726072.022726:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788726072.022747:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3305:x1875614935102848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788726072.022770:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788726072.022825:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3305:x1875614935102848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726072.022833:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788726072.022869:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788726072.022952:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935102848:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788726072.071539:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1788726072.071555:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788726072.071576:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:2.0:1788726072.341690:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788726072.597636:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788726072.597645:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788726072.597684:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788726072.597691:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788726072.597813:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875614935102976:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788726072.598281:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13aed0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788726072.602993:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726072.603130:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875614935102976:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788726072.605705:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914144512 00000100:00100000:0.0:1788726072.605721:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914144512 00000100:00100000:0.0:1788726072.605895:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 215 00000100:00100000:0.0:1788726072.605909:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+60:11587:x1875614914144512:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788726072.605944:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788726072.606069:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+60:11587:x1875614914144512:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 163us (3086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726072.606077:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 215 00000100:00080000:2.0:1788726072.614444:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726072.621899:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726072.622116:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914144640 00000100:00100000:2.0:1788726072.622127:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914144640 00000100:00100000:2.0:1788726072.622182:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 216 00000100:00100000:2.0:1788726072.622194:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+60:11587:x1875614914144640:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788726072.622325:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1f62 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622341:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1f62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622353:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1f62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622453:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1f69 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622462:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1f69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622469:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1f69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622507:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1f70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622517:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622524:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726072.622575:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788726072.622580:0:7629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726072.622595:0:7629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622607:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1f62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622613:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1f62 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622621:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1f62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622638:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726072.622642:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1f62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622649:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1f62 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622663:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:2.0:1788726072.622666:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726072.622671:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1f62 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622677:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1f62 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622693:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1f69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622698:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1f69 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622704:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1f69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622709:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eba00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726072.622712:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1f69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622718:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1f69 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622737:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff91a11214cb00) 00010000:00010000:2.0:1788726072.622740:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726072.622743:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1f69 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622749:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1f69 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622766:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622772:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1f70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622778:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1f70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622784:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eac00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726072.622786:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1f70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622792:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1f70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622800:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:2.0:1788726072.622802:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726072.622805:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1f70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.622810:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1f70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726072.622901:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+60:11587:x1875614914144640:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 707us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726072.622910:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 216 00000100:00100000:3.0:1788726072.630443:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726072.630548:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914144896 00000100:00100000:0.0:1788726072.630568:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914144896 00000100:00100000:0.0:1788726072.630633:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 217 00000100:00100000:0.0:1788726072.630645:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+60:11587:x1875614914144896:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788726072.630668:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726072.630689:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1f77 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a321 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.630794:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.630809:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.630821:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726072.630848:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788726072.630948:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.630957:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.630964:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.630969:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726072.630974:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.630981:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.630994:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:0.0:1788726072.630997:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788726072.631002:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.631008:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.631062:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1f77 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a321 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.631073:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:0.0:1788726072.631075:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788726072.631086:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1f77 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a321 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.631097:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724600, rc 0) 00000100:00100000:0.0:1788726072.631161:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+61:11587:x1875614914144896:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 519us (730us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788726072.631169:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 217 00000100:00100000:3.0:1788726072.644108:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726072.644270:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914145024 00000100:00100000:2.0:1788726072.644285:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914145024 00000100:00100000:2.0:1788726072.644364:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 218 00000100:00100000:2.0:1788726072.644375:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+61:11587:x1875614914145024:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788726072.644412:0:7629:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788726072.644519:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+61:11587:x1875614914145024:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 145us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726072.644526:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 218 00000100:00100000:3.0:1788726072.652650:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726072.652836:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914145280 00000100:00100000:0.0:1788726072.652847:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914145280 00000100:00100000:0.0:1788726072.652903:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 219 00000100:00100000:0.0:1788726072.652910:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+61:11587:x1875614914145280:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788726072.652932:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726072.652935:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788726072.652964:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1f1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a305 expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.652985:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:0.0:1788726072.652990:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788726072.653002:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1f8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a328 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788726072.653466:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788726072.653849:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.653862:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.653872:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.653938:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1f8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a328 expref: 63 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.653953:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a328 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.653961:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a12bdfeb00) 00010000:00010000:0.0:1788726072.653963:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788726072.653966:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725200, rc 0) 00000100:00100000:0.0:1788726072.654196:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+62:11587:x1875614914145280:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1282us (1553us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788726072.654205:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 219 00000100:00100000:3.0:1788726072.665110:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726072.665756:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914145536 00000100:00100000:2.0:1788726072.665768:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914145536 00000100:00100000:2.0:1788726072.665843:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 220 00000100:00100000:2.0:1788726072.665853:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+62:11587:x1875614914145536:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788726072.665917:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726072.665947:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c1f93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a328 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.665966:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a12bdfeb00) 00010000:00010000:2.0:1788726072.665976:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788726072.665997:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1fa1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666011:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666049:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666105:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fa8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x408af9dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666114:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x408af9dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666121:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x408af9dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666186:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666194:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1fa1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666200:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1fa1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666207:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eac00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726072.666211:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1fa1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666812:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1fa1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666823:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:2.0:1788726072.666827:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726072.666831:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1fa1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666848:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eac00/0xcbde9110e47c1fa1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666861:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x408af9dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666867:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fa8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x408af9dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666873:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x408af9dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666878:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eba00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726072.666882:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x408af9dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666888:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fa8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x408af9dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666895:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x408af9dd (ffff91a11214cb00) 00010000:00010000:2.0:1788726072.666898:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726072.666901:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fa8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x408af9dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.666907:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fa8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x408af9dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726072.667009:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+61:11587:x1875614914145536:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 1154us (1910us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788726072.667017:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 220 00000100:00100000:0.0:1788726072.676491:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726072.676660:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914145664 00000100:00100000:2.0:1788726072.676671:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914145664 00000100:00100000:2.0:1788726072.676729:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 221 00000100:00100000:2.0:1788726072.676740:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+61:11587:x1875614914145664:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726072.676762:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726072.676785:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1faf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a32f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.676822:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1fb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.676836:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.676848:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.677042:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1faf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a32f expref: 63 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.677065:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a32f expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.677073:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a11214c000) 00010000:00010000:2.0:1788726072.677076:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788726072.677080:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ebe00, rc 0) 00000100:00100000:2.0:1788726072.678143:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+62:11587:x1875614914145664:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1397us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726072.678154:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 221 00000100:00100000:3.0:1788726072.690095:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726072.690765:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914145920 00000100:00100000:0.0:1788726072.690779:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914145920 00000100:00100000:0.0:1788726072.690854:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 222 00000100:00100000:0.0:1788726072.690867:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+62:11587:x1875614914145920:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788726072.690999:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1fbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.691017:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.691029:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788726072.691730:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1788726072.691755:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367741538678ns, next at 368741536282ns, rc = 0 00000004:00010000:0.0:1788726072.691858:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004211a98d reply state 000000003ac7fd5e transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726072.691869:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788726072.692817:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+64:11587:x1875614914145920:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 1945us (2725us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788726072.692827:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 222 00010000:00010000:1.0:1788726072.699911:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726072.699941:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1fbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726072.699949:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1fbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726072.699955:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726072.699960:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1fbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726072.699968:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1fbd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726072.699987:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a11214c000) 00010000:00010000:1.0:1788726072.699990:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788726072.699995:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1fbd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726072.700001:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c1fbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726072.704094:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726072.714252:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914146048 00000100:00100000:0.0:1788726072.714269:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914146048 00000100:00100000:0.0:1788726072.714356:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 223 00000100:00100000:0.0:1788726072.714367:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+63:11587:x1875614914146048:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788726072.714393:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726072.714414:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1fc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a336 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.714479:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a336 expref: 64 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.714493:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a336 expref: 64 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.714512:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a11214c000) 00010000:00010000:0.0:1788726072.714516:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788726072.714520:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725000, rc 0) 00000100:00100000:0.0:1788726072.714822:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+64:11587:x1875614914146048:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 455us (10738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726072.714829:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 223 00000100:00100000:2.0:1788726072.725187:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726072.725438:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914146176 00000100:00100000:0.0:1788726072.725448:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914146176 00000100:00100000:0.0:1788726072.725527:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:0.0:1788726072.725539:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2350:x1875614914146176:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788726072.725868:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:2350:x1875614914146176:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 330us (689us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788726072.725876:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00080000:1.0:1788726072.726027:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788726072.733132:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726072.733501:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914146432 00000100:00100000:0.0:1788726072.733512:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914146432 00000100:00100000:0.0:1788726072.733581:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:0.0:1788726072.733592:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+64:11587:x1875614914146432:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788726072.733827:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+65:11587:x1875614914146432:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 236us (703us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788726072.733836:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:3.0:1788726072.741139:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726072.741261:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914146688 00000100:00100000:2.0:1788726072.741271:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914146688 00000100:00100000:2.0:1788726072.742733:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 224 00000100:00100000:2.0:1788726072.742757:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+65:11587:x1875614914146688:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788726072.742904:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+65:11587:x1875614914146688:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 156us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726072.742911:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 224 00000100:00100000:1.0:1788726072.749169:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726072.749277:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914146816 00000100:00100000:2.0:1788726072.749296:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914146816 00000100:00100000:2.0:1788726072.749359:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 225 00000100:00100000:2.0:1788726072.749370:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+65:11587:x1875614914146816:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726072.749391:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726072.749413:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1fcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a33d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.749486:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.749501:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.749512:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726072.749757:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726072.749782:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.749827:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb200/0xcbde9110e47c1fcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a33d expref: 67 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.749846:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a33d expref: 66 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.749855:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a11214c000) 00010000:00010000:2.0:1788726072.749858:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788726072.749862:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eba00, rc 0) 00000100:00100000:2.0:1788726072.749968:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+66:11587:x1875614914146816:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 599us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726072.749976:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 225 00000100:00100000:3.0:1788726072.760571:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726072.761479:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914146944 00000100:00100000:0.0:1788726072.761491:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914146944 00000100:00100000:0.0:1788726072.761566:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:0.0:1788726072.761577:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+10:2349:x1875614914146944:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788726072.761596:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726072.761617:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e54f159d/0xcbde9110e47c1fd9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a344 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726072.761645:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9dcb38, blocks: 0x1 00010000:00010000:0.0:1788726072.761664:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=367s v=(0 0) 00010000:00010000:0.0:1788726072.761668:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726072.761678:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e54f159d/0xcbde9110e47c1fd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a344 expref: 11 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.761712:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e54f159d/0xcbde9110e47c1fd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a344 expref: 11 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.761726:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724c00, rc 0) 00000100:00100000:0.0:1788726072.761792:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:2349:x1875614914146944:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 217us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726072.761800:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:2.0:1788726072.769959:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726072.770582:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914147200 00000100:00100000:3.0:1788726072.770593:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914147200 00000100:00100000:3.0:1788726072.770656:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 226 00000100:00100000:3.0:1788726072.770667:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+66:11587:x1875614914147200:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788726072.770782:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+66:11587:x1875614914147200:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 117us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726072.770790:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 226 00000100:00100000:1.0:1788726072.781664:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726072.782186:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914147328 00000100:00100000:0.0:1788726072.782200:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914147328 00000100:00100000:0.0:1788726072.782320:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:0.0:1788726072.782331:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:11587:x1875614914147328:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788726072.782348:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726072.782368:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1fe0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a34b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.782401:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e54f159d/0xcbde9110e47c1fd9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a344 expref: 12 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.782410:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726072.782414:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726072.782419:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1fe0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a34b expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.782452:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e54f159d/0xcbde9110e47c1fd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a344 expref: 12 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.782479:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e54f159d/0xcbde9110e47c1fd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a344 expref: 12 pid: 6683 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726072.782495:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a907480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1875614935103104:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726072.782778:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a139cde240 going to sleep for 11 seconds 00000100:00100000:2.0:1788726072.793969:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726072.794072:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914147456 00000100:00100000:3.0:1788726072.794082:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914147456 00010000:00010000:3.0:1788726072.794126:0:8495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e54f159d/0xcbde9110e47c1fd9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a344 expref: 13 pid: 6683 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726072.794264:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:3.0:1788726072.794276:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:2350:x1875614914147456:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726072.794301:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726072.794337:0:8495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e54f159d/0xcbde9110e47c1fd9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a344 expref: 13 pid: 6683 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.794352:0:8495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e54f159d/0xcbde9110e47c1fd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a344 expref: 13 pid: 6683 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.794379:0:8495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726072.794384:0:8495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726072.794392:0:8495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1fe0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a34b expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.794402:0:8495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1fe0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a34b expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.794438:0:8495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1fe0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a34b expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726072.794452:0:8495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111614000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8495:1875614935103232:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788726072.794526:0:8495:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10dfc2240 going to sleep for 11 seconds 00010000:00010000:0.0:1788726072.796334:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e54f159d/0xcbde9110e47c1fd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a344 expref: 13 pid: 6683 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726072.796360:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a907480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1875614935103104:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726072.796390:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1fe0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a34b expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726072.796405:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724600, rc 0) 00000100:00100000:0.0:1788726072.796465:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+12:11587:x1875614914147328:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 14134us (14812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726072.796475:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:3.0:1788726072.808119:0:8495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111614000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8495:1875614935103232:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788726072.808149:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726072.808211:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:2350:x1875614914147456:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 13936us (14251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726072.808254:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:2.0:1788726072.815877:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726072.815963:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914147584 00000100:00100000:1.0:1788726072.815988:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914147584 00002000:00100000:1.0:1788726072.816066:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff91a1116f1500 x1875614914147584/t0(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:468/0 lens 504/0 e 0 to 0 dl 1788726083 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788726072.816078:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a1116f1500 with x1875614914147584 ext(0->12) 00002000:00010000:1.0:1788726072.816083:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a1116f1500 00000100:00100000:1.0:1788726072.816105:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:1.0:1788726072.816114:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+11:2350:x1875614914147584:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788726072.816999:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:2350:x1875614914147584:12345-192.168.201.42@tcp:4:lhsmtool_posix.0 Request processed in 880us (1127us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788726072.817010:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00002000:00100000:1.0:1788726072.817019:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff91a1116f1500 x1875614914147584/t4294967320(0) o4->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:468/0 lens 504/448 e 0 to 0 dl 1788726083 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788726072.818181:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a1116f1500 with x1875614914147584 ext(0->12) 00002000:00010000:1.0:1788726072.818190:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a1116f1500 00000100:00100000:2.0:1788726072.820596:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726072.820755:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914147712 00000100:00100000:0.0:1788726072.820767:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914147712 00000100:00100000:0.0:1788726072.820832:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 227 00000100:00100000:0.0:1788726072.820843:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+66:11587:x1875614914147712:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788726072.914936:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1788726072.914958:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:2.0:1788726072.914994:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a141d6c000 refcount 2 committed 0 result 0 batchid 6 00000100:00100000:3.0:1788726072.915459:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935103360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788726072.915528:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726072.915800:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935103488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788726072.915826:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726072.915862:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935103360 00000100:00100000:3.0:1788726072.915869:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935103360 00000100:00100000:3.0:1788726072.915909:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935103488 00000100:00100000:3.0:1788726072.915912:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935103488 00000100:00100000:3.0:1788726072.915932:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788726072.915940:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1875614935103360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788726072.915966:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1788726072.915989:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c1fe7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.916154:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0f9e0e8/0xcbde9110e47c1da9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a2aa expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.916164:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788726072.916169:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788726072.916174:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c1fe7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.916203:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0f9e0e8/0xcbde9110e47c1da9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2aa expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788726072.916367:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a112838f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a141d6cc00 00000020:00080000:2.0:1788726072.916371:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a112838b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a13aec0c00 00000004:00080000:2.0:1788726072.916407:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:2.0:1788726072.916437:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788726072.916450:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a141d6ca80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788726072.916453:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a111794e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a141d6cb40 00000020:00080000:2.0:1788726072.916464:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a111794b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a13a4c0800 00000020:00080000:2.0:1788726072.916501:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00010000:00010000:3.0:1788726072.916717:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0f9e0e8/0xcbde9110e47c1da9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2aa expref: 12 pid: 6682 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726072.916734:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111615500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875614935103616:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726072.916818:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10dfc2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788726072.916839:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788726072.916849:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1875614935103488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788726072.916995:0:9742:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788726072.917010:0:9742:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788726072 00002000:00010000:3.0:1788726072.917013:0:9742:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788726072.917016:0:9742:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788726072 -> 1788726072 00002000:00010000:3.0:1788726072.917018:0:9742:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000020:00080000:2.0:1788726072.918020:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788726072.920901:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3306:x1875614935103488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4048us (5068us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788726072.920915:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788726072.921611:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:11587:x1875614914147712:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 100766us (101020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726072.921622:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 227 00000100:00100000:3.0:1788726072.922425:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935103744:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788726072.922480:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726072.922530:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935103744 00000100:00100000:3.0:1788726072.922537:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935103744 00000004:00080000:1.0:1788726072.922679:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a111615180/2, rc 0, transno 4294967321 00000100:00100000:1.0:1788726072.922687:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935103488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788726072.925211:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788726072.925253:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935103744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788726072.925295:0:6683:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1788726072.925332:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9dcb37, atime: 0x6a9dcb37, ctime: 0x6a9dcb37, blocks: 0xb 00010000:00010000:3.0:1788726072.925341:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008974e10e/0xcbde9110e47c1fee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.925357:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1788726072.925361:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726072.925368:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008974e10e/0xcbde9110e47c1fee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.925404:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008974e10e/0xcbde9110e47c1fee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.925414:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008974e10e/0xcbde9110e47c1fee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.925422:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008974e10e/0xcbde9110e47c1fee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.925436:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726072.926463:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726072.926475:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008974e10e/0xcbde9110e47c1fee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.926487:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914200 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726072.926491:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008974e10e/0xcbde9110e47c1fee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.926501:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008974e10e/0xcbde9110e47c1fee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.926520:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008974e10e/0xcbde9110e47c1fee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.926528:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008974e10e/0xcbde9110e47c1fee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.926563:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726072.926565:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726072.926566:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726072.928124:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111615500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875614935103616:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726072.928152:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c1fe7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726072.929460:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875614935103744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4203us (6972us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788726072.929474:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788726072.929598:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1788726072.929604:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:1.0:1788726072.929623:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a141d2d500, transno 4294967307 00000004:00080000:1.0:1788726072.929640:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:1.0:1788726072.929654:0:3307:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff91a13a907480 x1875614935103744/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788726088 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788726072.929666:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a13a907480/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788726072.929671:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935103744:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788726072.933751:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726072.933893:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914147840 00000100:00100000:3.0:1788726072.933903:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914147840 00000100:00100000:3.0:1788726072.933958:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 71 00000100:00100000:3.0:1788726072.933968:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:2350:x1875614914147840:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788726072.934447:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726072.934539:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914147968 00000100:00100000:2.0:1788726072.934553:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914147968 00010000:00010000:2.0:1788726072.934578:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f9e0e8/0xcbde9110e47c1da9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2aa expref: 14 pid: 6682 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726072.934604:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:2.0:1788726072.934610:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a906300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+14:2349:x1875614914147968:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726072.934619:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726072.934624:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0f9e0e8/0xcbde9110e47c1da9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2aa expref: 14 pid: 6682 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.934637:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0f9e0e8/0xcbde9110e47c1da9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2aa expref: 14 pid: 6682 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.934658:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0f9e0e8/0xcbde9110e47c1da9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.42@tcp remote: 0x228275be9055a2aa expref: 14 pid: 6682 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.934673:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788726072.934677:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788726072.934682:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c1fe7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.934691:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c1fe7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.934733:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726072.934788:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a906300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+13:2349:x1875614914147968:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 177us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726072.934794:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 83 00010000:00010000:2.0:1788726072.934905:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c1fe7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.934914:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c1fe7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.934924:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c1fe7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.934931:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c1fe7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726072.934946:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788726072.935458:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3305:x1875614935103360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19518us (19930us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788726072.935465:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:3.0:1788726072.936484:0:8494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726072.936492:0:8494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c1fe7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.936503:0:8494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:3.0:1788726072.936508:0:8494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c1fe7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.936534:0:8494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c1fe7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.936564:0:8494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c1fe7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.936571:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c1fe7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726072.936591:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726072.936592:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726072.936594:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788726072.936634:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a111614000/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788726072.936641:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935103360:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788726073.035525:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+12:2350:x1875614914147840:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 101547us (101774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726073.035539:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 71 00000001:00080000:1.0:1788726073.036118:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:1.0:1788726073.036133:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1788726073.036141:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:1.0:1788726073.036152:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:0.0:1788726073.039945:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726073.040043:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914148224 00000100:00100000:3.0:1788726073.040053:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914148224 00000100:00100000:3.0:1788726073.040113:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 228 00000100:00100000:3.0:1788726073.040123:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:11587:x1875614914148224:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788726073.040177:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726073.040204:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c1fd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a33d expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.040265:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a11214c000) 00010000:00010000:3.0:1788726073.040270:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788726073.040654:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ff5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.040683:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.040691:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788726073.040938:0:7629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a03e7f5b reply state 00000000b63a8ddc transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726073.040948:0:7629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788726073.041134:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:11587:x1875614914148224:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 1011us (1197us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788726073.041143:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 228 00010000:00010000:0.0:1788726073.044904:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726073.044919:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ff5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726073.044927:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726073.044933:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726073.044937:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726073.044944:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ff5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726073.044961:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a11214c000) 00010000:00010000:0.0:1788726073.044964:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726073.044968:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ff5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726073.044972:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915400/0xcbde9110e47c1ff5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726073.053778:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726073.053881:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914148352 00000100:00100000:3.0:1788726073.053892:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914148352 00000100:00100000:3.0:1788726073.053953:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:3.0:1788726073.053964:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914148352:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788726073.054305:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788726073.054310:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788726072 -> 1788726071 00002000:00010000:3.0:1788726073.054312:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788726071 00002000:00010000:3.0:1788726073.054315:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788726072 -> 1788726071 00002000:00010000:3.0:1788726073.054317:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788726073.054374:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2349:x1875614914148352:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 410us (607us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788726073.054382:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 72 00000100:00100000:2.0:1788726073.057665:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726073.057784:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914148608 00000100:00100000:1.0:1788726073.057794:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914148608 00000100:00100000:1.0:1788726073.057859:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 229 00000100:00100000:1.0:1788726073.057870:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:11587:x1875614914148608:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788726073.057939:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1ffc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.057957:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1fb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a32f expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.057966:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1ffc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.058012:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a32f expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.058035:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a32f expref: 20 pid: 5836 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726073.058050:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b159180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875614935103872:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788726073.058183:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a104bb2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788726073.061962:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726073.062581:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914148736 00000100:00100000:2.0:1788726073.062608:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914148736 00010000:00010000:2.0:1788726073.062649:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1fb6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a32f expref: 21 pid: 5836 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726073.062694:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 84 00000100:00100000:2.0:1788726073.062704:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a905500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:2350:x1875614914148736:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726073.062718:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726073.062724:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1fb6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a32f expref: 21 pid: 5836 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.062737:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a32f expref: 21 pid: 5836 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.062760:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a11214c000) 00010000:00010000:2.0:1788726073.062766:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1ffc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.062774:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1ffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.062781:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1ffc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.062798:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726073.062857:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a905500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:2350:x1875614914148736:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 154us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726073.062864:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 84 00010000:00010000:1.0:1788726073.064267:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebe00/0xcbde9110e47c1fb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a32f expref: 20 pid: 5836 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726073.064329:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b159180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875614935103872:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788726073.064352:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1ffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.064361:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1ffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.064368:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1ffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.064397:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1ffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.064404:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1ffc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.064411:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1ffc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.064417:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726073.064421:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1ffc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.064428:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1ffc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.064442:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a11214c000) 00010000:00010000:1.0:1788726073.064445:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788726073.064449:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1ffc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.064461:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921a00/0xcbde9110e47c1ffc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726073.064520:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:11587:x1875614914148608:12345-192.168.201.42@tcp:55:lhsmtool_posix.0 Request processed in 6651us (6864us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788726073.064529:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 229 00000100:00100000:0.0:1788726073.068646:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726073.068821:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914148864 00000100:00100000:1.0:1788726073.068832:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914148864 00000100:00100000:1.0:1788726073.068897:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:1.0:1788726073.068908:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2352:x1875614914148864:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788726073.068954:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000095cfbc97/0xcbde9110e47c2003 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.068976:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1fe0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a34b expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.068985:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788726073.068990:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788726073.069007:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095cfbc97/0xcbde9110e47c2003 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.069485:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1fe0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a34b expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.069503:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1fe0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a34b expref: 8 pid: 6682 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726073.069538:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b159180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1875614935104000:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788726073.069883:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a104bb2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788726073.085013:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726073.087310:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914148992 00000100:00100000:3.0:1788726073.087325:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914148992 00010000:00010000:3.0:1788726073.087393:0:8495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1fe0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a34b expref: 9 pid: 6682 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726073.087442:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:3.0:1788726073.087453:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2349:x1875614914148992:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726073.087470:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726073.087494:0:8495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1fe0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a34b expref: 9 pid: 6682 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.087509:0:8495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1fe0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a34b expref: 9 pid: 6682 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.087536:0:8495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788726073.087541:0:8495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788726073.087559:0:8495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000095cfbc97/0xcbde9110e47c2003 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.087569:0:8495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095cfbc97/0xcbde9110e47c2003 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.087594:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726073.087665:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+9:2349:x1875614914148992:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 213us (2669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726073.087674:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 85 00010000:00010000:1.0:1788726073.093066:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000969654ed/0xcbde9110e47c1fe0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a34b expref: 8 pid: 6682 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726073.093089:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b159180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1875614935104000:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788726073.093112:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000095cfbc97/0xcbde9110e47c2003 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.093121:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000095cfbc97/0xcbde9110e47c2003 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.093126:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095cfbc97/0xcbde9110e47c2003 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.093155:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000095cfbc97/0xcbde9110e47c2003 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.093161:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095cfbc97/0xcbde9110e47c2003 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.093166:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095cfbc97/0xcbde9110e47c2003 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.093188:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726073.093191:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095cfbc97/0xcbde9110e47c2003 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.093197:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095cfbc97/0xcbde9110e47c2003 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.093212:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095cfbc97/0xcbde9110e47c2003 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.093256:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095cfbc97/0xcbde9110e47c2003 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726073.093439:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2352:x1875614914148864:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 24532us (24801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726073.093450:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 73 00000100:00100000:0.0:1788726073.096915:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726073.097041:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914149248 00000100:00100000:3.0:1788726073.097052:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914149248 00000100:00100000:3.0:1788726073.097110:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 230 00000100:00100000:3.0:1788726073.097128:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:11587:x1875614914149248:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788726073.097207:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c200a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.097268:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c200a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.097279:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c200a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.097484:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c2011 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.097496:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1fc4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a336 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.097506:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c2011 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.097541:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a336 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.097923:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1fc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a336 expref: 20 pid: 5834 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726073.097939:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111617800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935104128:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726073.098083:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1095a3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788726073.103826:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726073.104503:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914149376 00000100:00100000:2.0:1788726073.104513:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914149376 00010000:00010000:2.0:1788726073.104581:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1fc4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a336 expref: 21 pid: 5834 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726073.104626:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:2.0:1788726073.104636:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:2349:x1875614914149376:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726073.104651:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726073.104658:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1fc4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a336 expref: 21 pid: 5834 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.104671:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1fc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a336 expref: 21 pid: 5834 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.104693:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a11214c000) 00010000:00010000:2.0:1788726073.104698:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c2011 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.104708:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c2011 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.104716:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c2011 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.104734:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726073.104797:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:2349:x1875614914149376:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 161us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726073.104804:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 86 00010000:00010000:3.0:1788726073.106517:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725000/0xcbde9110e47c1fc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a336 expref: 20 pid: 5834 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726073.106628:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111617800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935104128:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788726073.106654:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c2011 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.106663:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c2011 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.106669:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c2011 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788726073.106846:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788726073.109793:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788726073.109909:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788726073.110010:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111617800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875614935104256:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788726073.110091:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726073.110126:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13a947240 going to sleep for 11 seconds 00000100:00100000:1.0:1788726073.110286:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935104256 00000100:00100000:1.0:1788726073.110294:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935104256 00000100:00100000:1.0:1788726073.110363:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788726073.110375:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1875614935104256:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788726073.110450:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1875614935104256:12345-0@lo:1000:mdt00_001.0 Request processed in 79us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726073.110458:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788726073.110491:0:5835:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1788726073.110496:0:5835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:1.0:1788726073.110524:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a111615180, transno 4294967321 00000004:00080000:1.0:1788726073.110534:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a111614000, transno 4294967322 00000100:00100000:1.0:1788726073.110542:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111617800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875614935104256:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788726073.110960:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788726073.111034:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b159180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875614935104384:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788726073.111063:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726073.111082:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1012ed180 going to sleep for 11 seconds 00000100:00100000:1.0:1788726073.111385:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935104384 00000100:00100000:1.0:1788726073.111391:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935104384 00000100:00100000:1.0:1788726073.111413:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788726073.111419:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1875614935104384:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788726073.111557:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1875614935104384:12345-0@lo:1000:mdt00_001.0 Request processed in 137us (493us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788726073.111565:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788726073.111594:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b159180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875614935104384:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788726073.111622:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c2011 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.111632:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c2011 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.111641:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c2011 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.111647:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726073.111652:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c2011 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.111659:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c2011 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.111682:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a11214c000) 00010000:00010000:1.0:1788726073.111685:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788726073.111689:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c2011 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.111697:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915800/0xcbde9110e47c2011 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.111724:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1f54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.111731:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1f54 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.111737:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1f54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.111743:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726073.111746:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1f54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.111752:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1f54 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.111760:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:1.0:1788726073.111763:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788726073.111770:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1f5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a31a expref: 23 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.111782:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1f5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a31a expref: 23 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.111797:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1f5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a31a expref: 23 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.111822:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1f5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a31a expref: 23 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726073.111833:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b158e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935104512:192.168.201.42@tcp:105: 00000100:00100000:1.0:1788726073.111891:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10408a780 going to sleep for 11 seconds 00000100:00080000:3.0:1788726073.113335:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788726073.116199:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b158e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875614935104512:192.168.201.42@tcp:105: 00010000:00010000:1.0:1788726073.116268:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1f54 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116287:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c1f54 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116323:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2018 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116336:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2018 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116347:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2018 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116357:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2018 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116362:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2018 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116383:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2018 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116388:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726073.116392:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2018 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116399:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2018 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116411:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:1.0:1788726073.116414:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726073.116417:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2018 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116423:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2018 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116433:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c200a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116439:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c200a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116445:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c200a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116450:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915600 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726073.116453:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c200a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116469:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c200a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116477:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:1.0:1788726073.116480:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788726073.116482:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c200a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.116488:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915600/0xcbde9110e47c200a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726073.116985:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:11587:x1875614914149248:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 19857us (20077us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788726073.116995:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 230 00000020:00080000:0.0:1788726073.117001:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788726073.117805:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788726073.117812:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788726073.118907:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788726073.118923:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788726073.121624:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726073.121771:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914149504 00000100:00100000:0.0:1788726073.121782:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914149504 00000100:00100000:0.0:1788726073.121837:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:0.0:1788726073.121849:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:11586:x1875614914149504:12345-192.168.201.42@tcp:49:lfs.0 00000100:00100000:0.0:1788726073.121991:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:11586:x1875614914149504:12345-192.168.201.42@tcp:49:lfs.0 Request processed in 143us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726073.122007:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:3.0:1788726073.130463:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726073.130511:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726073.130812:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914150016 00000100:00100000:2.0:1788726073.130822:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914150016 00000100:00100000:2.0:1788726073.130878:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:2.0:1788726073.130903:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a103398450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+23:11587:x1875614914150016:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788726073.131976:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788726073.132161:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788726073.132473:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c201f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.132492:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c201f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.132505:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c201f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.132515:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c201f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.132522:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c201f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.132529:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c201f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.132661:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788726073.132773:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a103398450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+25:11587:x1875614914150016:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 1868us (2255us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788726073.132783:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00000020:00080000:2.0:1788726073.132789:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788726073.132893:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914149760 00000100:00100000:0.0:1788726073.132902:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914149760 00000100:00100000:0.0:1788726073.132949:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 231 00000100:00100000:0.0:1788726073.132958:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+25:11586:x1875614914149760:12345-192.168.201.42@tcp:58:lfs.0 00000040:00080000:0.0:1788726073.133166:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788726073.133211:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+25:11586:x1875614914149760:12345-192.168.201.42@tcp:58:lfs.0 Request processed in 254us (2757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726073.133256:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 231 00010000:00010000:1.0:1788726073.139482:0:8493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726073.139497:0:8493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c201f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.139509:0:8493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea000 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726073.139514:0:8493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c201f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.139524:0:8493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c201f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.139616:0:8493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91a11214cb00) 00010000:00010000:1.0:1788726073.139620:0:8493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788726073.139626:0:8493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c201f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.139648:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c201f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726073.139676:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726073.139678:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726073.139680:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726073.184742:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726073.184841:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914150144 00000100:00100000:3.0:1788726073.184852:0:7629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914150144 00000100:00100000:3.0:1788726073.184953:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 232 00000100:00100000:3.0:1788726073.184965:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+25:11589:x1875614914150144:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726073.185004:0:7629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726073.185036:0:7629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c2026 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a352 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.185129:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c202d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.185143:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c202d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.185155:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c202d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.185170:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c2034 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.185178:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c2034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.185186:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c2034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.185854:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c203b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.185870:0:7629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a313 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.185879:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c203b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.185916:0:7629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a313 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.185945:0:7629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a313 expref: 26 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726073.185962:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111614000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935104640:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726073.186083:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13a947cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726073.190481:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111614000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7629:1875614935104640:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726073.190514:0:7629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c203b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726073.191833:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726073.191962:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914150400 00000100:00100000:3.0:1788726073.191971:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914150400 00000100:00100000:3.0:1788726073.192045:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:3.0:1788726073.192057:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:5590:x1875614914150400:12345-192.168.201.42@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788726073.193981:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:5590:x1875614914150400:12345-192.168.201.42@tcp:35:ldlm_bl.0 Request processed in 1919us (2147us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788726073.193994:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 63 00000100:00100000:1.0:1788726073.196918:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726073.197003:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914150528 00000100:00100000:3.0:1788726073.197014:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914150528 00010000:00010000:3.0:1788726073.197075:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a313 expref: 28 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726073.197120:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00100000:3.0:1788726073.197131:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1128e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:2349:x1875614914150528:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726073.197146:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726073.197153:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a313 expref: 28 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.197166:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a313 expref: 28 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.197186:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725e00/0xcbde9110e47c1f46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a313 expref: 28 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.197569:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:3.0:1788726073.197576:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c203b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.197588:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c203b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.197597:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c203b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726073.197632:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726073.197694:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1128e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:2349:x1875614914150528:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 564us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726073.197703:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 87 00010000:00010000:2.0:1788726073.198865:0:7629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c203b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.198881:0:7629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c203b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726073.198930:0:7629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788726073.198934:0:7629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726073.198955:0:7629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c203b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.198969:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c203b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.198979:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c202d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.198984:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c202d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.198991:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c202d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.198997:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726073.199001:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c202d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.199039:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c202d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.199053:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:2.0:1788726073.199056:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726073.199060:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c202d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.199066:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914400/0xcbde9110e47c202d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.199081:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c2034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.199087:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c2034 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.199093:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c2034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.199099:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726073.199102:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c2034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.199108:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c2034 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.199115:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91a111639f00) 00010000:00010000:2.0:1788726073.199117:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726073.199120:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c2034 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.199136:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914c00/0xcbde9110e47c2034 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.199176:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914a00/0xcbde9110e47c2026 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a352 expref: 27 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.199192:0:7629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c203b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a352 expref: 26 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726073.199200:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:2.0:1788726073.199202:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726073.199205:0:7629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915000, rc 0) 00000100:00100000:2.0:1788726073.199479:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:11589:x1875614914150144:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 14514us (14744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726073.199488:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 232 00010000:00010000:2.0:1788726073.367392:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788726074.118332:0:12454:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788726074.118342:0:12454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788726074.118425:0:12454:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788726074.118431:0:12454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788726074.134434:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788726074.134444:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788726074.134481:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788726074.134487:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788726074.134663:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b159880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875614935104768:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788726074.134752:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1095a33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726074.154815:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b159880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875614935104768:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788726074.157420:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726074.157691:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914150656 00000100:00100000:1.0:1788726074.157705:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914150656 00000100:00080000:3.0:1788726074.157818:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726074.158396:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 233 00000100:00100000:1.0:1788726074.158411:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:11600:x1875614914150656:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788726074.158447:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788726074.158555:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:11600:x1875614914150656:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 147us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726074.158562:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 233 00000100:00100000:1.0:1788726074.164918:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726074.165023:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914150912 00000100:00100000:2.0:1788726074.165035:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914150912 00000100:00100000:2.0:1788726074.165096:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 234 00000100:00100000:2.0:1788726074.165107:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+26:11600:x1875614914150912:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726074.165129:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726074.165149:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c2042 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a359 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726074.165292:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c2049 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726074.165560:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c2049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726074.165576:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c2049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726074.165589:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788726074.165727:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea600/0xcbde9110e47c2042 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a359 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726074.165744:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c2049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a359 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726074.165753:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:2.0:1788726074.165756:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726074.165760:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea000, rc 0) 00000100:00100000:2.0:1788726074.165825:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:11600:x1875614914150912:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 720us (919us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788726074.165833:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 234 00000100:00100000:0.0:1788726074.172463:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726074.172556:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726074.173418:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914151040 00000100:00100000:3.0:1788726074.173431:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914151040 00000100:00100000:3.0:1788726074.173509:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:3.0:1788726074.173521:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:2350:x1875614914151040:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726074.173537:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726074.173565:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea000/0xcbde9110e47c2049 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a359 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726074.173600:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:3.0:1788726074.173605:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726074.173672:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:2350:x1875614914151040:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 152us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726074.173680:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:2.0:1788726074.174062:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914151296 00000100:00100000:2.0:1788726074.174069:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914151296 00000100:00100000:2.0:1788726074.174110:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 235 00000100:00100000:2.0:1788726074.174118:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+27:11600:x1875614914151296:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788726074.174189:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2057 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726074.174205:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726074.174252:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726074.174446:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726074.174454:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2057 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726074.174461:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2057 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726074.174467:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726074.174472:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2057 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726074.174479:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2057 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726074.174489:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:2.0:1788726074.174492:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788726074.174496:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2057 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726074.174502:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2057 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726074.174631:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:11600:x1875614914151296:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 513us (2074us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788726074.174639:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 235 00000040:00080000:3.0:1788726074.175504:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788726074.175511:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788726074.175995:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788726074.176003:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788726074.178948:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726074.179024:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914151552 00000100:00100000:2.0:1788726074.179035:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914151552 00000100:00100000:2.0:1788726074.179105:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 64 00000100:00100000:2.0:1788726074.179117:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+28:11600:x1875614914151552:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788726074.179613:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:11600:x1875614914151552:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 497us (671us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788726074.179621:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 64 00010000:00010000:2.0:1788726074.389663:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726075.301858:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726075.301903:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726075.301934:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726075.301964:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726075.302019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726075.302083:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914151936 00000100:00100000:3.0:1788726075.302095:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914151936 00000100:00100000:2.0:1788726075.302115:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914152064 00000100:00100000:2.0:1788726075.302119:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914152064 00000100:00100000:3.0:1788726075.302163:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:3.0:1788726075.302174:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2352:x1875614914151936:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726075.302181:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914151680 00000100:00100000:0.0:1788726075.302185:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914151680 00000100:00100000:0.0:1788726075.302240:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 295 00000100:00100000:0.0:1788726075.302247:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2352:x1875614914151680:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:1.0:1788726075.302310:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788726075.302314:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788726075.302456:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2352:x1875614914151936:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 282us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726075.302464:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:3.0:1788726075.302483:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 94 00000100:00100000:3.0:1788726075.302491:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2352:x1875614914152064:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788726075.306864:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914152192 00000100:00100000:2.0:1788726075.306886:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914152192 00000100:00100000:2.0:1788726075.307518:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914151808 00000100:00100000:2.0:1788726075.307525:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914151808 00000100:00100000:2.0:1788726075.307569:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 153 00000100:00100000:2.0:1788726075.307580:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2352:x1875614914152192:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726075.307716:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2352:x1875614914151680:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 5467us (5867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726075.307727:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 295 00000100:00080000:0.0:1788726075.307791:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726075.307809:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 154 00000100:00100000:0.0:1788726075.307818:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:2352:x1875614914151808:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726075.307850:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:2352:x1875614914151808:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 34us (5885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726075.307856:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 154 00000100:00100000:2.0:1788726075.320551:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2352:x1875614914152192:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 12953us (18595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726075.320572:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 153 00000100:00100000:3.0:1788726075.320688:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2352:x1875614914152064:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 18195us (18666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726075.320700:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 94 00010000:00010000:3.0:1788726075.415680:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726075.605530:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935105280:0@lo:400:kworker.0 00000100:00100000:0.0:1788726075.605612:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726075.605681:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788726075.605688:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935105152:0@lo:400:kworker.0 00000100:00100000:0.0:1788726075.605714:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726075.605753:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935105280 00000100:00100000:0.0:1788726075.605760:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935105280 00000100:00100000:0.0:1788726075.605817:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788726075.605826:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935105280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726075.605876:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935105280:12345-0@lo:400:kworker.0 Request processed in 52us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726075.605884:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788726075.605906:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935105152 00000100:00100000:0.0:1788726075.605910:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935105152 00000100:00100000:0.0:1788726075.605937:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788726075.605944:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875614935105152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726075.606007:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875614935105152:12345-0@lo:400:kworker.0 Request processed in 64us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726075.606013:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1788726075.606029:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788726075.606034:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726075.606070:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935105152:0@lo:400:kworker.0 00000100:00100000:0.0:1788726075.606079:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935105280:0@lo:400:kworker.0 00000100:00100000:3.0:1788726075.607677:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935104896:0@lo:400:kworker.0 00000100:00100000:3.0:1788726075.607744:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726075.607811:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935105408:0@lo:400:kworker.0 00000100:00100000:3.0:1788726075.607841:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726075.607867:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788726075.607874:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935105024:0@lo:400:kworker.0 00000100:00100000:3.0:1788726075.607899:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726075.607918:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935105536:0@lo:400:kworker.0 00000100:00100000:3.0:1788726075.607938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726075.607966:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935105408 00000100:00100000:3.0:1788726075.607973:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935105408 00000100:00100000:3.0:1788726075.608030:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935105024 00000100:00100000:3.0:1788726075.608033:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935105024 00000100:00100000:3.0:1788726075.608050:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788726075.608058:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935105408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726075.608105:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935105408:12345-0@lo:400:kworker.0 Request processed in 48us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726075.608112:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788726075.608126:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788726075.608131:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935105024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726075.608154:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935105024:12345-0@lo:400:kworker.0 Request processed in 23us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726075.608160:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788726075.608176:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935105536 00000100:00100000:3.0:1788726075.608179:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935105536 00000100:00100000:3.0:1788726075.608555:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788726075.608563:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875614935105536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726075.608600:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875614935105536:12345-0@lo:400:kworker.0 Request processed in 38us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726075.608615:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788726075.608656:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935105024:0@lo:400:kworker.0 00000100:00100000:3.0:1788726075.608668:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935105536:0@lo:400:kworker.0 00000100:00100000:3.0:1788726075.608677:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935105408:0@lo:400:kworker.0 00000100:00100000:0.0:1788726075.609823:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935104896 00000100:00100000:0.0:1788726075.609835:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935104896 00000100:00100000:0.0:1788726075.609886:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788726075.609895:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935104896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726075.609962:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935104896:12345-0@lo:400:kworker.0 Request processed in 69us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726075.609969:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:0.0:1788726075.610017:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788726075.610023:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726075.610051:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935104896:0@lo:400:kworker.0 00000040:00080000:2.0:1788726076.067369:0:12505:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788726076.067381:0:12505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788726076.067433:0:12505:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788726076.067439:0:12505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788726076.120200:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a005960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935105664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788726076.120326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726076.120552:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935105664 00000100:00100000:3.0:1788726076.120561:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935105664 00000100:00100000:3.0:1788726076.120617:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788726076.120627:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1116f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875614935105664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788726076.120664:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788726076.120716:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1116f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875614935105664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726076.120722:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788726076.120749:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a005960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935105664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788726076.292601:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726076.292705:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914152448 00000100:00100000:3.0:1788726076.292715:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914152448 00000100:00100000:3.0:1788726076.292776:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 236 00000100:00100000:3.0:1788726076.292788:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+29:11621:x1875614914152448:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726076.292807:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726076.292826:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c205e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a360 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726076.292923:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c2065 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726076.292938:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c2065 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726076.292979:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c2065 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726076.292993:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788726076.293191:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915e00/0xcbde9110e47c205e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a360 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726076.293210:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c2065 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a360 expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726076.293538:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:3.0:1788726076.293542:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788726076.293546:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914600, rc 0) 00000100:00100000:3.0:1788726076.293623:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+31:11621:x1875614914152448:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 835us (1031us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788726076.293631:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 236 00000100:00080000:3.0:1788726076.293660:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726076.300494:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726076.301058:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914152576 00000100:00100000:0.0:1788726076.301069:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914152576 00000100:00100000:0.0:1788726076.301134:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 237 00000100:00100000:0.0:1788726076.301146:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+31:11621:x1875614914152576:12345-192.168.201.42@tcp:54:lfs.0 00010000:00010000:0.0:1788726076.301915:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c2073 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726076.301938:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c2073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726076.301961:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c2073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726076.302001:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c2073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726076.302009:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c2073 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726076.302016:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c2073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726076.302022:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726076.302027:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c2073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726076.302035:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c2073 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726076.302047:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:0.0:1788726076.302050:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788726076.302056:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c2073 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726076.302062:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724400/0xcbde9110e47c2073 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726076.302137:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+31:11621:x1875614914152576:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 991us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726076.302146:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 237 00000100:00100000:0.0:1788726076.419520:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726076.419881:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914152704 00000100:00100000:2.0:1788726076.419901:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914152704 00000100:00100000:2.0:1788726076.419999:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:2.0:1788726076.420011:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2350:x1875614914152704:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:2.0:1788726076.420029:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726076.420051:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096de80d0/0xcbde9110e47c207a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a367 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788726076.420081:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9dcb37, atime: 0x6a9dcb37, ctime: 0x6a9dcb37, blocks: 0xb 00010000:00010000:2.0:1788726076.420102:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=371s v=(0 0) 00010000:00010000:2.0:1788726076.420107:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726076.420131:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096de80d0/0xcbde9110e47c207a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a367 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726076.420151:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096de80d0/0xcbde9110e47c207a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a367 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726076.420165:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eaa00, rc 0) 00000100:00100000:2.0:1788726076.421589:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2350:x1875614914152704:12345-192.168.201.42@tcp:101:cat.0 Request processed in 1573us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726076.421600:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 74 00000100:00100000:2.0:1788726076.433125:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726076.433275:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914152832 00000100:00100000:3.0:1788726076.433287:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914152832 00002000:00100000:3.0:1788726076.433344:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff91a13a906a00 x1875614914152832/t0(0) o3->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:472/0 lens 488/0 e 0 to 0 dl 1788726087 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788726076.433355:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13a906a00 with x1875614914152832 ext(0->4095) 00002000:00010000:3.0:1788726076.433359:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a13a906a00 00000100:00100000:3.0:1788726076.433549:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:3.0:1788726076.433560:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2349:x1875614914152832:12345-192.168.201.42@tcp:3:cat.0 00000100:00100000:3.0:1788726076.433781:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+8:2349:x1875614914152832:12345-192.168.201.42@tcp:3:cat.0 Request processed in 222us (666us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788726076.433790:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00002000:00100000:3.0:1788726076.433796:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff91a13a906a00 x1875614914152832/t0(0) o3->7c11f8bd-dcce-4bc6-a067-83d611fb0a24@192.168.201.42@tcp:472/0 lens 488/4536 e 0 to 0 dl 1788726087 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788726076.433804:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13a906a00 with x1875614914152832 ext(0->4095) 00002000:00010000:3.0:1788726076.433807:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91a13a906a00 00010000:00010000:1.0:1788726076.437633:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726077.144249:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935105792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788726077.144319:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726077.144586:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935105792 00000100:00100000:2.0:1788726077.144594:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935105792 00000100:00100000:2.0:1788726077.144659:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788726077.144670:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875614935105792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788726077.144702:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788726077.144766:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875614935105792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726077.144773:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788726077.144816:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935105792:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788726077.144991:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788726077.205492:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:2.0:1788726077.473836:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788726078.242905:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1788726078.242926:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1788726078.248109:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000020:00080000:2.0:1788726078.248121:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91a104bb2600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788726078.248127:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a112838700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91a104bb2000 00000020:00080000:2.0:1788726078.248130:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91a112838c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91a13ab29400 00000020:00080000:2.0:1788726078.248149:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:2.0:1788726078.248553:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:2.0:1788726078.248661:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:2.0:1788726078.248674:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1788726078.248753:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000040:00080000:3.0:1788726078.296683:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788726078.296693:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788726078.296734:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788726078.296741:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788726078.485431:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726079.516653:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726080.429811:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726080.429864:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726080.429912:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726080.429950:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726080.429980:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726080.430051:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914153472 00000100:00100000:1.0:1788726080.430064:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914153472 00000100:00100000:1.0:1788726080.430129:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914153088 00000100:00100000:1.0:1788726080.430132:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914153088 00000100:00100000:1.0:1788726080.430162:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 158 00000100:00100000:1.0:1788726080.430173:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914153472:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726080.430295:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2350:x1875614914153472:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 124us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726080.430316:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 158 00000100:00100000:1.0:1788726080.430335:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 159 00000100:00100000:1.0:1788726080.430342:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:2350:x1875614914153088:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726080.430372:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:2350:x1875614914153088:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 30us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726080.430379:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 159 00000100:00080000:1.0:1788726080.430396:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726080.430794:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914152960 00000100:00100000:0.0:1788726080.430800:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914152960 00000100:00100000:0.0:1788726080.430840:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 297 00000100:00100000:0.0:1788726080.430850:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2350:x1875614914152960:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726080.430888:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2306ca11-4668-43b2-bddf-879669734d27+13:2350:x1875614914152960:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 40us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726080.430895:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 297 00000100:00100000:2.0:1788726080.434419:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914153216 00000100:00100000:2.0:1788726080.434435:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914153216 00000100:00080000:0.0:1788726080.434612:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788726080.435082:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914153344 00000100:00100000:2.0:1788726080.435088:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914153344 00000100:00100000:2.0:1788726080.435140:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00100000:2.0:1788726080.435151:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a005963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2350:x1875614914153216:12345-192.168.201.42@tcp:400:kworker.0 00000100:00080000:0.0:1788726080.435203:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788726080.435250:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:2.0:1788726080.435251:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a005963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2350:x1875614914153216:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 103us (5387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726080.435259:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00100000:0.0:1788726080.435259:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2350:x1875614914153344:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726080.435289:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2350:x1875614914153344:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 33us (5309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726080.435295:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 98 00010000:00010000:1.0:1788726080.534274:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726080.731172:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935106048:0@lo:400:kworker.0 00000100:00100000:1.0:1788726080.731301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726080.731366:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935106560:0@lo:400:kworker.0 00000100:00100000:1.0:1788726080.731404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726080.731448:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788726080.731454:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935105920:0@lo:400:kworker.0 00000100:00100000:1.0:1788726080.731483:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726080.731505:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935106432:0@lo:400:kworker.0 00000100:00100000:1.0:1788726080.731525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726080.731547:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935106304:0@lo:400:kworker.0 00000100:00100000:1.0:1788726080.731568:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726080.731584:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788726080.731588:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1117cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935106176:0@lo:400:kworker.0 00000100:00100000:1.0:1788726080.731608:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726080.731636:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935105920 00000100:00100000:1.0:1788726080.731644:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935105920 00000100:00100000:0.0:1788726080.732027:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935106560 00000100:00100000:0.0:1788726080.732032:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935106560 00000100:00100000:0.0:1788726080.732081:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935106176 00000100:00100000:0.0:1788726080.732085:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935106176 00000100:00100000:0.0:1788726080.732115:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788726080.732124:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935106560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726080.732195:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935106560:12345-0@lo:400:kworker.0 Request processed in 72us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726080.732202:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788726080.732241:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788726080.732249:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935106176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726080.732301:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935106176:12345-0@lo:400:kworker.0 Request processed in 53us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726080.732308:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1788726080.732325:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788726080.732329:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788726080.732352:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788726080.732358:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91a13a907480, transno 4294967310 00000100:00100000:0.0:1788726080.732372:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1117cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935106176:0@lo:400:kworker.0 00000100:00100000:0.0:1788726080.732718:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788726080.732724:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1788726080.732744:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935106560:0@lo:400:kworker.0 00000100:00100000:0.0:1788726080.732792:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935106048 00000100:00100000:0.0:1788726080.732796:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935106048 00000100:00100000:0.0:1788726080.732819:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935106432 00000100:00100000:0.0:1788726080.732821:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935106432 00000100:00100000:0.0:1788726080.732836:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935106304 00000100:00100000:0.0:1788726080.732838:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935106304 00000100:00100000:0.0:1788726080.732849:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788726080.732854:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935106048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726080.732890:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935106048:12345-0@lo:400:kworker.0 Request processed in 36us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726080.732910:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788726080.732920:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788726080.732926:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935106432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726080.732950:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935106432:12345-0@lo:400:kworker.0 Request processed in 25us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726080.732966:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788726080.732975:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788726080.732981:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1089b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935106304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726080.733010:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1089b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935106304:12345-0@lo:400:kworker.0 Request processed in 30us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726080.733015:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1788726080.733030:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726080.733047:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935106304:0@lo:400:kworker.0 00000100:00100000:0.0:1788726080.733072:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935106432:0@lo:400:kworker.0 00000100:00100000:0.0:1788726080.733082:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935106048:0@lo:400:kworker.0 00000100:00100000:1.0:1788726080.733924:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788726080.733937:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935105920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726080.734001:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935105920:12345-0@lo:400:kworker.0 Request processed in 69us (2517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726080.734008:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788726080.734072:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935105920:0@lo:400:kworker.0 00000100:00100000:2.0:1788726081.237432:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788726081.237455:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935106688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788726081.237536:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726081.237645:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935106688 00000100:00100000:3.0:1788726081.237664:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935106688 00000100:00100000:3.0:1788726081.237727:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788726081.237740:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935106688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788726081.237774:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788726081.237820:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935106688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726081.237827:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788726081.237870:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935106688:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788726081.557598:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726082.261978:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788726082.262003:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935106816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788726082.262071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726082.262299:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935106816 00000100:00100000:0.0:1788726082.262376:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935106816 00000100:00080000:2.0:1788726082.262852:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788726082.263170:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788726082.263182:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935106816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788726082.263242:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726082.263321:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935106816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726082.263328:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788726082.267090:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935106816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788726082.342462:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726082.344149:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914153600 00000100:00100000:0.0:1788726082.344164:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914153600 00000100:00100000:0.0:1788726082.344283:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 238 00000100:00100000:0.0:1788726082.344294:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:11274:x1875614914153600:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788726082.344642:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:11274:x1875614914153600:12345-192.168.201.42@tcp:60:lhsmtool_posix.0 Request processed in 349us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726082.344668:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 238 00000100:00080000:2.0:1788726082.345297:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788726082.350348:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726082.350845:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914153856 00000100:00100000:3.0:1788726082.350856:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914153856 00000100:00100000:3.0:1788726082.350928:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 65 00000100:00100000:3.0:1788726082.350940:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:11274:x1875614914153856:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788726082.351589:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:11274:x1875614914153856:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 649us (1247us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788726082.351598:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 65 00010000:00010000:2.0:1788726082.581512:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726082.711901:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726082.712145:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914153984 00000100:00100000:0.0:1788726082.712156:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914153984 00000100:00100000:0.0:1788726082.712329:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 239 00000100:00100000:0.0:1788726082.712341:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:12072:x1875614914153984:12345-192.168.201.42@tcp:101:lsof.0 00010000:00010000:0.0:1788726082.712363:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726082.712385:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c2081 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a36e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726082.712451:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c2088 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726082.712466:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c2088 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726082.712478:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c2088 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726082.712512:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788726082.712515:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788726082.712532:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c2088 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726082.712552:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e724600/0xcbde9110e47c2081 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a36e expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726082.712568:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c2088 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a36e expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726082.712594:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d500) 00010000:00010000:0.0:1788726082.712597:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788726082.712600:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725200, rc 0) 00000100:00100000:0.0:1788726082.712667:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:12072:x1875614914153984:12345-192.168.201.42@tcp:101:lsof.0 Request processed in 329us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726082.712674:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 239 00000100:00080000:2.0:1788726082.713038:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00080000:3.0:1788726083.353589:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1788726083.353632:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788726083.353756:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788726083.353774:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788726083.605574:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726084.631438:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726085.544006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726085.544044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726085.544083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726085.544112:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914154112 00000100:00100000:0.0:1788726085.544121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726085.544124:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914154112 00000100:00100000:0.0:1788726085.544164:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726085.544182:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 299 00000100:00100000:0.0:1788726085.544192:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914154624 00000100:00100000:3.0:1788726085.544196:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1055d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:2349:x1875614914154112:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726085.544198:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914154624 00000100:00100000:0.0:1788726085.544265:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914154240 00000100:00100000:0.0:1788726085.544269:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914154240 00000100:00100000:0.0:1788726085.544305:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 163 00000100:00100000:0.0:1788726085.544314:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:2349:x1875614914154624:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726085.544384:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:2349:x1875614914154624:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 73us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726085.544394:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 163 00000100:00100000:0.0:1788726085.544410:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 164 00000100:00100000:0.0:1788726085.544416:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:2349:x1875614914154240:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726085.544453:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:2349:x1875614914154240:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 36us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726085.544460:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 164 00000100:00100000:0.0:1788726085.544498:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914154368 00000100:00100000:0.0:1788726085.544502:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914154368 00000100:00100000:0.0:1788726085.544542:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914154496 00000100:00100000:0.0:1788726085.544546:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914154496 00000100:00100000:0.0:1788726085.544566:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:0.0:1788726085.544572:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2349:x1875614914154368:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726085.544600:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2349:x1875614914154368:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726085.544607:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:0.0:1788726085.544619:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:0.0:1788726085.544626:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914154496:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726085.544650:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2349:x1875614914154496:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726085.544656:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00080000:0.0:1788726085.544673:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788726085.544677:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788726085.544680:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726085.545822:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1055d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:2349:x1875614914154112:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 1614us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726085.553571:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 299 00010000:00010000:2.0:1788726085.657640:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726085.852881:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935107200:0@lo:400:kworker.0 00000100:00100000:3.0:1788726085.852988:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726085.853166:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935106944:0@lo:400:kworker.0 00000100:00100000:0.0:1788726085.853209:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726085.853273:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935106944 00000100:00100000:0.0:1788726085.853296:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935106944 00000100:00100000:1.0:1788726085.853376:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935107072:0@lo:400:kworker.0 00000100:00100000:1.0:1788726085.853426:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726085.853464:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935107072 00000100:00100000:1.0:1788726085.853467:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935107072 00000100:00100000:1.0:1788726085.853535:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788726085.853546:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935107072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726085.853612:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935107072:12345-0@lo:400:kworker.0 Request processed in 67us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726085.853620:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788726085.853663:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935107328:0@lo:400:kworker.0 00000100:00100000:1.0:1788726085.853688:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726085.853720:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935107328 00000100:00100000:1.0:1788726085.853723:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935107328 00000100:00100000:1.0:1788726085.853765:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788726085.853771:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935107328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726085.853806:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875614935107328:12345-0@lo:400:kworker.0 Request processed in 35us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726085.853836:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1788726085.853862:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788726085.857976:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935107200 00000100:00100000:2.0:1788726085.858001:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935107200 00000100:00100000:2.0:1788726085.858107:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788726085.858120:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935107200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726085.858298:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935107200:12345-0@lo:400:kworker.0 Request processed in 180us (5310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726085.858306:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1788726085.858333:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788726085.858374:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935107200:0@lo:400:kworker.0 00000100:00100000:0.0:1788726085.862597:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935107456:0@lo:400:kworker.0 00000100:00100000:0.0:1788726085.862714:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726085.862857:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935107072:0@lo:400:kworker.0 00000100:00100000:0.0:1788726085.862868:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935107584:0@lo:400:kworker.0 00000100:00100000:0.0:1788726085.862903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726085.862983:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935107456 00000100:00100000:0.0:1788726085.862992:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935107456 00000100:00100000:0.0:1788726085.863063:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788726085.863655:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788726085.863675:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935106944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726085.863764:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935106944:12345-0@lo:400:kworker.0 Request processed in 97us (10553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726085.863784:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788726085.863864:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935106944:0@lo:400:kworker.0 00000100:00100000:0.0:1788726085.865257:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935107456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726085.865988:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935107584 00000100:00100000:1.0:1788726085.866003:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935107584 00000100:00100000:1.0:1788726085.866090:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788726085.866100:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935107584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726085.866169:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935107584:12345-0@lo:400:kworker.0 Request processed in 70us (3264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726085.866177:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788726085.866261:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875614935107328:0@lo:400:kworker.0 00000100:00080000:1.0:1788726085.866331:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788726085.866337:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726085.866364:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935107584:0@lo:400:kworker.0 00000100:00100000:0.0:1788726085.867281:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935107456:12345-0@lo:400:kworker.0 Request processed in 2029us (4553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726085.867295:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788726085.875707:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935107456:0@lo:400:kworker.0 00000100:00100000:1.0:1788726086.358089:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788726086.358127:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935107712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788726086.358269:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726086.358395:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935107712 00000100:00100000:1.0:1788726086.358406:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935107712 00000100:00100000:1.0:1788726086.358477:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788726086.358488:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935107712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788726086.358540:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788726086.358594:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935107712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726086.358602:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788726086.358658:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935107712:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788726086.677435:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788726086.835206:0:12708:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:21:25 (1788726085) 00000100:00100000:3.0:1788726087.382027:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935107840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788726087.382161:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726087.384331:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935107840 00000100:00100000:3.0:1788726087.384371:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935107840 00000100:00080000:1.0:1788726087.391009:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788726087.397924:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788726087.397969:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935107840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788726087.398049:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788726087.398192:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935107840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 244us (16030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726087.398201:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788726087.398984:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935107840:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788726087.701833:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788726088.535092:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788726088.535107:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788726088.535793:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788726088.535805:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788726088.726186:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726089.750368:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726090.662106:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726090.662150:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726090.662186:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726090.662242:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726090.662274:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726090.662305:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914155136 00000100:00100000:0.0:1788726090.662314:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914155136 00000100:00100000:0.0:1788726090.662366:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914155008 00000100:00100000:0.0:1788726090.662370:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914155008 00000100:00100000:0.0:1788726090.662395:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:0.0:1788726090.662405:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2352:x1875614914155136:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726090.662480:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2352:x1875614914155136:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 76us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726090.662488:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:1.0:1788726090.662509:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914154880 00000100:00100000:0.0:1788726090.662516:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:1.0:1788726090.662524:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914154880 00000100:00100000:0.0:1788726090.662531:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2352:x1875614914155008:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726090.662566:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2352:x1875614914155008:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 39us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726090.662574:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:1.0:1788726090.662594:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914155264 00000100:00100000:1.0:1788726090.662599:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914155264 00000100:00100000:0.0:1788726090.662605:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 168 00000100:00100000:3.0:1788726090.662672:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914154752 00000100:00100000:3.0:1788726090.662678:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914154752 00000100:00100000:3.0:1788726090.662711:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 301 00000100:00100000:3.0:1788726090.662719:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:2352:x1875614914154752:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726090.662757:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2306ca11-4668-43b2-bddf-879669734d27+13:2352:x1875614914154752:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 40us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726090.662764:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 301 00000100:00080000:3.0:1788726090.662823:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788726090.662828:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788726090.662830:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788726090.662999:0:7629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:2352:x1875614914154880:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726090.663045:0:7629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:2352:x1875614914154880:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 414us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726090.670839:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 169 00000100:00100000:1.0:1788726090.670955:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:2352:x1875614914155264:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726090.671093:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:2352:x1875614914155264:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 162us (8816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726090.671103:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 169 00000100:00100000:0.0:1788726090.681598:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 168 00010000:00010000:1.0:1788726090.773501:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726090.965577:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935107968:0@lo:400:kworker.0 00000100:00100000:3.0:1788726090.965654:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726090.965712:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935108480:0@lo:400:kworker.0 00000100:00100000:3.0:1788726090.965752:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726090.965780:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788726090.965789:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935108096:0@lo:400:kworker.0 00000100:00100000:3.0:1788726090.965812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726090.965843:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935108608:0@lo:400:kworker.0 00000100:00100000:3.0:1788726090.965868:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726090.965897:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935108480 00000100:00100000:3.0:1788726090.965905:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935108480 00000100:00100000:3.0:1788726090.965967:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935108096 00000100:00100000:3.0:1788726090.965984:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935108096 00000100:00100000:3.0:1788726090.966009:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788726090.966018:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935108480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726090.966069:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875614935108480:12345-0@lo:400:kworker.0 Request processed in 51us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726090.966076:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788726090.966093:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788726090.966099:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935108096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726090.966144:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935108096:12345-0@lo:400:kworker.0 Request processed in 45us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726090.966150:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:3.0:1788726090.966165:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726090.966195:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935108096:0@lo:400:kworker.0 00000100:00100000:3.0:1788726090.966204:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935108480:0@lo:400:kworker.0 00000100:00100000:1.0:1788726090.966371:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935107968 00000100:00100000:1.0:1788726090.966375:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935107968 00000100:00100000:1.0:1788726090.966413:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788726090.966430:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935107968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726090.966470:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3304:x1875614935107968:12345-0@lo:400:kworker.0 Request processed in 43us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726090.966477:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788726090.966687:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3304:1875614935107968:0@lo:400:kworker.0 00000100:00100000:1.0:1788726090.966942:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935108224:0@lo:400:kworker.0 00000100:00100000:1.0:1788726090.966975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726090.967003:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788726090.967010:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935108352:0@lo:400:kworker.0 00000100:00100000:1.0:1788726090.967035:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726090.967062:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935108352 00000100:00100000:1.0:1788726090.967067:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935108352 00000100:00100000:1.0:1788726090.967099:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788726090.967105:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935108352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726090.967155:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935108352:12345-0@lo:400:kworker.0 Request processed in 51us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726090.967162:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:1.0:1788726090.967176:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726090.967195:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935108352:0@lo:400:kworker.0 00000100:00100000:3.0:1788726090.967349:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935108608 00000100:00100000:3.0:1788726090.967354:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935108608 00000100:00100000:3.0:1788726090.967396:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935108224 00000100:00100000:3.0:1788726090.967400:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935108224 00000100:00100000:3.0:1788726090.967424:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788726090.967432:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935108608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726090.967471:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935108608:12345-0@lo:400:kworker.0 Request processed in 39us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726090.967478:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788726090.967490:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788726090.967496:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935108224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726090.967539:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935108224:12345-0@lo:400:kworker.0 Request processed in 43us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726090.967546:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788726090.967579:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935108608:0@lo:400:kworker.0 00000100:00080000:1.0:1788726090.969763:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788726090.969773:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788726090.969842:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935108224:0@lo:400:kworker.0 00000100:00100000:2.0:1788726091.477526:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788726091.477550:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935108736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788726091.477625:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726091.477773:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935108736 00000100:00100000:0.0:1788726091.477783:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935108736 00000100:00100000:0.0:1788726091.477834:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788726091.477844:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935108736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788726091.477880:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726091.477936:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935108736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726091.477943:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788726091.478065:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935108736:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788726091.799107:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726092.389456:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726092.389556:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914155520 00000100:00100000:2.0:1788726092.389567:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914155520 00000100:00100000:2.0:1788726092.389643:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00100000:2.0:1788726092.389653:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+18:12294:x1875614914155520:12345-192.168.201.42@tcp:35:umount.0 00000100:00100000:2.0:1788726092.390034:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:12294:x1875614914155520:12345-192.168.201.42@tcp:35:umount.0 Request processed in 382us (587us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788726092.390043:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 66 00000100:00080000:1.0:1788726092.390132:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788726092.399099:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726092.399425:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914155776 00000100:00100000:0.0:1788726092.399436:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914155776 00000100:00100000:0.0:1788726092.399498:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:0.0:1788726092.399509:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+19:12294:x1875614914155776:12345-192.168.201.42@tcp:35:umount.0 00000100:00100000:0.0:1788726092.400409:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:12294:x1875614914155776:12345-192.168.201.42@tcp:35:umount.0 Request processed in 899us (1319us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788726092.400422:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 67 00000100:00100000:0.0:1788726092.410055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726092.410187:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914156032 00000100:00100000:3.0:1788726092.410198:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914156032 00000100:00100000:3.0:1788726092.410304:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:3.0:1788726092.410314:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a103398850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+20:12294:x1875614914156032:12345-192.168.201.42@tcp:35:umount.0 00000100:00100000:3.0:1788726092.410941:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a103398850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:12294:x1875614914156032:12345-192.168.201.42@tcp:35:umount.0 Request processed in 626us (893us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788726092.410950:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 68 00000100:00100000:2.0:1788726092.415413:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726092.415539:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914156288 00000100:00100000:3.0:1788726092.415561:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914156288 00000100:00100000:3.0:1788726092.415623:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:3.0:1788726092.415635:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:12294:x1875614914156288:12345-192.168.201.42@tcp:35:umount.0 00000100:00100000:3.0:1788726092.416062:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:12294:x1875614914156288:12345-192.168.201.42@tcp:35:umount.0 Request processed in 427us (658us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788726092.416070:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 69 00000100:00100000:2.0:1788726092.422634:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726092.422775:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914157056 00000100:00100000:3.0:1788726092.422787:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914157056 00000100:00100000:3.0:1788726092.422864:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:3.0:1788726092.422875:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+7:2348:x1875614914157056:12345-192.168.201.42@tcp:9:umount.0 00000020:00000080:3.0:1788726092.422905:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c1640 00000020:00010000:3.0:1788726092.422913:0:6680:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91a13b10b800: total 0 00000100:00080000:3.0:1788726092.422930:0:6680:0:(import.c:65:import_set_state_nolock()) ffff91a13b10a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788726092.422977:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:1.0:1788726092.423048:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788726092.423301:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2348:x1875614914157056:12345-192.168.201.42@tcp:9:umount.0 Request processed in 427us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726092.423310:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 75 00000020:00010000:2.0:1788726092.423454:0:8493:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91a13b10b800: total 0 00010000:00010000:2.0:1788726092.423486:0:8493:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91a13b10b800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788726092.423553:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bf51c36/0xcbde9110e47c19dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a199 expref: 4 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726092.423588:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096de80d0/0xcbde9110e47c207a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a367 expref: 3 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726092.423603:0:8493:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91a13b10b800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788726092.423614:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726092.423616:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726092.423617:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726092.430160:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726092.430200:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726092.430267:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726092.430388:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914156416 00000100:00100000:0.0:1788726092.430399:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914156416 00000100:00100000:3.0:1788726092.430437:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914156672 00000100:00100000:3.0:1788726092.430442:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914156672 00000100:00100000:0.0:1788726092.430453:0:8495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914156544 00000100:00100000:0.0:1788726092.430455:0:8495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914156544 00000100:00100000:3.0:1788726092.430470:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:3.0:1788726092.430553:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2306ca11-4668-43b2-bddf-879669734d27+15:2352:x1875614914156416:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726092.430571:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726092.430592:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100031a00/0xcbde9110e47c109e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ef9 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726092.430609:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726092.430618:0:8495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:0.0:1788726092.430626:0:8495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2306ca11-4668-43b2-bddf-879669734d27+14:2352:x1875614914156672:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726092.430642:0:8495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726092.430652:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100031800/0xcbde9110e47c1314 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fc4 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726092.430660:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2306ca11-4668-43b2-bddf-879669734d27+13:2352:x1875614914156416:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 112us (511us total) trans 0 rc 0/0 00010000:00010000:0.0:1788726092.430661:0:8495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726092.430667:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:0.0:1788726092.430678:0:8495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2306ca11-4668-43b2-bddf-879669734d27+12:2352:x1875614914156672:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 54us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726092.430684:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:3.0:1788726092.430690:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2306ca11-4668-43b2-bddf-879669734d27+12:2352:x1875614914156544:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726092.430711:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726092.430721:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10db71000/0xcbde9110e47c1066 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559ec1 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726092.430729:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726092.430747:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2306ca11-4668-43b2-bddf-879669734d27+11:2352:x1875614914156544:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 58us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726092.430753:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:0.0:1788726092.430932:0:8495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:1.0:1788726092.433774:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726092.433857:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914157184 00000100:00100000:3.0:1788726092.433866:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914157184 00000100:00100000:3.0:1788726092.433937:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:3.0:1788726092.433948:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+5:2348:x1875614914157184:12345-192.168.201.42@tcp:9:umount.0 00000020:00000080:3.0:1788726092.433978:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c13d8 00000100:00080000:3.0:1788726092.433987:0:6683:0:(import.c:65:import_set_state_nolock()) ffff91a104c79800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788726092.434018:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788726092.434025:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788726092.434333:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+2:2348:x1875614914157184:12345-192.168.201.42@tcp:9:umount.0 Request processed in 387us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726092.434341:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00080000:1.0:1788726092.434582:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788726092.444015:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726092.444253:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914158208 00000100:00100000:1.0:1788726092.444265:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914158208 00000100:00100000:1.0:1788726092.444330:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 240 00000100:00100000:1.0:1788726092.444341:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+22:2348:x1875614914158208:12345-192.168.201.42@tcp:39:umount.0 00000020:00000080:1.0:1788726092.444375:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c1074 00000020:00010000:1.0:1788726092.444392:0:5835:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91a13f00d800: total 0 00000100:00080000:1.0:1788726092.444396:0:5835:0:(import.c:65:import_set_state_nolock()) ffff91a13adc5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788726092.444466:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1788726092.444835:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c11f8bd-dcce-4bc6-a067-83d611fb0a24+21:2348:x1875614914158208:12345-192.168.201.42@tcp:39:umount.0 Request processed in 495us (829us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788726092.444843:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 240 00000020:00010000:3.0:1788726092.449870:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91a13f00d800: total 0 00010000:00010000:3.0:1788726092.449933:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91a13f00d800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788726092.449970:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:3.0:1788726092.449975:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788726092.449988:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c18bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a14c expref: 20 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726092.450011:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726092.450014:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788726092.450018:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c13ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fee expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726092.450034:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:3.0:1788726092.450037:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788726092.450041:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c1f5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a31a expref: 18 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726092.450053:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:3.0:1788726092.450067:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788726092.450070:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920a00/0xcbde9110e47c1a5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1bc expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726092.450079:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:3.0:1788726092.450081:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726092.450083:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921e00/0xcbde9110e47c135a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fd9 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726092.450190:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d500) 00010000:00010000:3.0:1788726092.450192:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788726092.450195:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920600/0xcbde9110e47c1a3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a1b5 expref: 15 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726092.450203:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:3.0:1788726092.450205:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788726092.450207:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914600/0xcbde9110e47c2065 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a360 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726092.450233:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:3.0:1788726092.450235:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726092.450237:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915a00/0xcbde9110e47c199d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a184 expref: 13 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726092.450245:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:3.0:1788726092.450246:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788726092.450248:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a914000/0xcbde9110e47c19c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a192 expref: 12 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726092.450271:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91a111639400) 00010000:00010000:3.0:1788726092.450274:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726092.450278:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a13a915000/0xcbde9110e47c203b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a352 expref: 11 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726092.450293:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91a10d14d800) 00010000:00010000:3.0:1788726092.450295:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788726092.450299:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725400/0xcbde9110e47c1d39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a28e expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726092.450314:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726092.450316:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788726092.450319:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a100031000/0xcbde9110e47c169b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a0c0 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726092.450335:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91a11214c200) 00010000:00010000:3.0:1788726092.450336:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788726092.450339:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a117437a00/0xcbde9110e47c133e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fd2 expref: 8 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726092.450349:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91a13f00d800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788726092.450360:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726092.450361:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726092.450363:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726092.502527:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788726092.502553:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935108864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788726092.502643:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726092.502690:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935108864 00000100:00100000:0.0:1788726092.502708:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935108864 00000100:00100000:0.0:1788726092.502772:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788726092.503208:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788726092.503304:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935108864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788726092.503341:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788726092.503401:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935108864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 619us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726092.503410:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788726092.503461:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935108864:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788726092.571951:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000020:00000080:1.0:1788726092.571960:0:6711:0:(genops.c:885:class_export_put()) final put ffff91a104c7b800/7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000020:00000080:0.0:1788726092.572029:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a104c7b800/7c11f8bd-dcce-4bc6-a067-83d611fb0a24 for lustre-OST0000 00000020:00000080:0.0:1788726092.572103:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a104c79800 for lustre-OST0000 00010000:00010000:2.0:1788726092.821921:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788726093.592247:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00100000:2.0:1788726093.592265:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000001:00080000:2.0:1788726093.592284:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1788726093.592300:0:5857:0:(genops.c:885:class_export_put()) final put ffff91a13f00d800/7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000020:00000080:3.0:1788726093.592385:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13f00d800/7c11f8bd-dcce-4bc6-a067-83d611fb0a24 for lustre-MDT0000 00000020:00000080:3.0:1788726093.592458:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a13adc5800 for lustre-MDT0000 00000001:00100000:2.0:1788726093.613968:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000020:00000080:2.0:1788726093.613979:0:7632:0:(genops.c:885:class_export_put()) final put ffff91a13b10b800/7c11f8bd-dcce-4bc6-a067-83d611fb0a24 00000020:00000080:3.0:1788726093.614065:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13b10b800/7c11f8bd-dcce-4bc6-a067-83d611fb0a24 for lustre-OST0001 00000020:00000080:3.0:1788726093.614143:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a13b10a000 for lustre-OST0001 00010000:00010000:2.0:1788726093.845723:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726094.869432:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726095.416357:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726095.416398:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726095.416440:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726095.416504:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914158464 00000100:00100000:1.0:1788726095.416517:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914158464 00000100:00100000:1.0:1788726095.416623:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914158336 00000100:00100000:1.0:1788726095.416628:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914158336 00000100:00100000:3.0:1788726095.417536:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914158592 00000100:00100000:3.0:1788726095.417547:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914158592 00000100:00100000:3.0:1788726095.417613:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:3.0:1788726095.417624:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139865880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2306ca11-4668-43b2-bddf-879669734d27+12:2352:x1875614914158464:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726095.417640:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726095.417671:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e724200/0xcbde9110e47c114d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f38 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726095.417690:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726095.417749:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139865880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2306ca11-4668-43b2-bddf-879669734d27+11:2352:x1875614914158464:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 127us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726095.417757:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:3.0:1788726095.417776:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:3.0:1788726095.417783:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a909880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2306ca11-4668-43b2-bddf-879669734d27+10:2352:x1875614914158336:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726095.417791:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726095.417800:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a1398ea800/0xcbde9110e47c1146 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f0e expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726095.417809:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726095.417826:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a909880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2306ca11-4668-43b2-bddf-879669734d27+9:2352:x1875614914158336:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 44us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726095.417832:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:3.0:1788726095.417845:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:3.0:1788726095.417851:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1128e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2306ca11-4668-43b2-bddf-879669734d27+8:2352:x1875614914158592:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726095.418048:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726095.418073:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a117436400/0xcbde9110e47c130d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559fbd expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726095.418084:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726095.418104:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1128e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2306ca11-4668-43b2-bddf-879669734d27+7:2352:x1875614914158592:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 252us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726095.418110:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:0.0:1788726095.476554:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726095.476708:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914158848 00000100:00100000:1.0:1788726095.476719:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914158848 00000100:00100000:1.0:1788726095.476802:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 241 00000100:00100000:1.0:1788726095.476816:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+6:2348:x1875614914158848:12345-192.168.201.42@tcp:39:umount.0 00000020:00000080:1.0:1788726095.476873:0:5834:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c115b 00000020:00010000:1.0:1788726095.476882:0:5834:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91a141afc000: total 0 00000100:00080000:1.0:1788726095.476887:0:5834:0:(import.c:65:import_set_state_nolock()) ffff91a141afb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788726095.476910:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1788726095.477523:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a80b79b1-421f-4cd6-b6be-d8957417b61a+5:2348:x1875614914158848:12345-192.168.201.42@tcp:39:umount.0 Request processed in 710us (975us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788726095.477546:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 241 00000100:00080000:3.0:1788726095.477718:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1788726095.477729:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91a141afc000: total 0 00010000:00010000:3.0:1788726095.477771:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91a141afc000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788726095.477806:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14d500) 00010000:00010000:3.0:1788726095.477809:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788726095.477818:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a10e725200/0xcbde9110e47c2088 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a36e expref: 4 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726095.477840:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91a141afc000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788726095.477851:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726095.477853:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726095.477855:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726095.523749:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726095.523815:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914159104 00000100:00100000:2.0:1788726095.523826:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914159104 00000100:00100000:2.0:1788726095.523938:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 303 00000100:00100000:2.0:1788726095.523951:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+7:2348:x1875614914159104:12345-192.168.201.42@tcp:251:umount.0 00000020:00000080:2.0:1788726095.524007:0:5827:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c1051 00000020:00010000:2.0:1788726095.524016:0:5827:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91a006f01800: total 0 00000100:00080000:2.0:1788726095.524021:0:5827:0:(import.c:65:import_set_state_nolock()) ffff91a006f00000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788726095.524102:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2306ca11-4668-43b2-bddf-879669734d27+3:2348:x1875614914159104:12345-192.168.201.42@tcp:251:umount.0 Request processed in 154us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726095.524110:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 303 00000020:00010000:3.0:1788726095.524186:0:8494:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91a006f01800: total 0 00010000:00010000:3.0:1788726095.524190:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726095.524259:0:8494:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91a006f01800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788726095.524295:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e725c00/0xcbde9110e47c10a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be90559f00 expref: 2 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726095.524313:0:8494:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91a006f01800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788726095.524322:0:8494:0:(genops.c:885:class_export_put()) final put ffff91a006f01800/2306ca11-4668-43b2-bddf-879669734d27 00010000:00010000:3.0:1788726095.524334:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726095.524363:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726095.524364:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788726095.524375:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91a006f01800/2306ca11-4668-43b2-bddf-879669734d27 for MGS 00000020:00000080:3.0:1788726095.524417:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a006f00000 for MGS 00010000:00010000:2.0:1788726095.901442:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726096.087375:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935109120:0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.087442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726096.087494:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935109632:0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.087517:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726096.087555:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788726096.087560:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13b027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935108992:0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.087585:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726096.087603:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935109504:0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.087620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726096.087653:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1116a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935109248:0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.087692:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726096.087711:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788726096.087715:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a139865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935109376:0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.087733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726096.087759:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935109120 00000100:00100000:3.0:1788726096.087765:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935109120 00000100:00100000:3.0:1788726096.087805:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935109504 00000100:00100000:3.0:1788726096.087808:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935109504 00000100:00100000:3.0:1788726096.087824:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935109376 00000100:00100000:3.0:1788726096.087826:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935109376 00000100:00100000:3.0:1788726096.087843:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788726096.087849:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935109120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.087894:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935109120:12345-0@lo:400:kworker.0 Request processed in 44us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726096.087906:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788726096.087921:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788726096.087926:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935109504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.087952:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935109504:12345-0@lo:400:kworker.0 Request processed in 26us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726096.087957:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788726096.087966:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788726096.087972:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935109376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.087999:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935109376:12345-0@lo:400:kworker.0 Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726096.088005:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788726096.088023:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935109632 00000100:00100000:3.0:1788726096.088026:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935109632 00000100:00100000:3.0:1788726096.088051:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935109248 00000100:00100000:3.0:1788726096.088054:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935109248 00000100:00100000:3.0:1788726096.088072:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788726096.088078:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935109632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.088105:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935109632:12345-0@lo:400:kworker.0 Request processed in 28us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726096.088111:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788726096.088120:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788726096.088125:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935109248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.088145:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935109248:12345-0@lo:400:kworker.0 Request processed in 20us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726096.088150:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788726096.088172:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935108992 00000100:00100000:3.0:1788726096.088175:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935108992 00000100:00100000:3.0:1788726096.088195:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788726096.088200:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a106b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935108992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.088250:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a106b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3305:x1875614935108992:12345-0@lo:400:kworker.0 Request processed in 50us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726096.088256:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:3.0:1788726096.088290:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788726096.088294:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788726096.088296:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726096.088329:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a139865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935109376:0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.088338:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935109248:0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.088362:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935108992:0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.088371:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1116f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935109504:0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.088380:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13b027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935109120:0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.088388:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935109632:0@lo:400:kworker.0 00000100:00100000:3.0:1788726096.605786:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788726096.605812:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935109760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788726096.605913:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726096.606003:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935109760 00000100:00100000:3.0:1788726096.606014:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935109760 00000100:00100000:3.0:1788726096.606080:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788726096.606093:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935109760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788726096.606135:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788726096.606200:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935109760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726096.606208:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788726096.606279:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935109760:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788726096.917809:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788726097.422774:0:12908:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788726097.446360:0:12908:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788726097.446408:0:12908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10eb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.446423:0:12908:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c10eb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.446431:0:12908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c10eb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.446438:0:12908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c10eb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.446465:0:12908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788726097.446471:0:12908:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788726097.446490:0:12908:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788726097.446494:0:12908:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788726097.446501:0:12908:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788726097.446524:0:12908:0:(import.c:65:import_set_state_nolock()) ffff91a104edf800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788726097.446651:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875614935109888:0@lo:39:umount.0 00000100:00100000:2.0:1788726097.446721:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788726097.447066:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726097.447074:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c10eb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.447082:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030e00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788726097.447086:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c10eb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.447095:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbde9110e47c10eb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788726097.447103:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbde9110e47c10eb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726097.447119:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788726097.447122:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788726097.447125:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788726097.447159:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c10eb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.447165:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788726097.447192:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c10eb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.447198:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a100030e00/0xcbde9110e47c10e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c10eb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.447240:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726097.447243:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726097.447245:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726097.447253:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788726097.447265:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935110016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726097.447306:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726097.447789:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935109888 00000100:00100000:1.0:1788726097.447797:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935109888 00000100:00100000:1.0:1788726097.447851:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788726097.447861:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875614935109888:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788726097.447887:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0e6e 00000100:00080000:1.0:1788726097.447896:0:5835:0:(import.c:65:import_set_state_nolock()) ffff91a1398df800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788726097.447959:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1875614935109888:12345-0@lo:39:umount.0 Request processed in 99us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726097.447974:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1788726097.447983:0:5835:0:(genops.c:885:class_export_put()) final put ffff91a1398de800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1788726097.448256:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a104edf800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:0.0:1788726097.448267:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a1398de800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1788726097.448268:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875614935109888:0@lo:39:umount.0 00000020:00000080:0.0:1788726097.448310:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a1398df800 for lustre-MDT0000 00000100:00100000:0.0:1788726097.449301:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935110016 00000100:00100000:0.0:1788726097.449313:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935110016 00000100:00100000:0.0:1788726097.449382:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788726097.449391:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3306:x1875614935110016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726097.449405:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726097.449424:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a1398eb400/0xcbde9110e47c10eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbde9110e47c10e4 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.449449:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726097.449504:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:3306:x1875614935110016:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726097.449512:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788726097.449552:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3306:1875614935110016:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788726097.450595:0:12908:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788726097.450601:0:12908:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788726097.450607:0:12908:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788726097.451520:0:12908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451536:0:12908:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c10f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451544:0:12908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c10f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451551:0:12908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c10f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451567:0:12908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788726097.451572:0:12908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1012 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451579:0:12908:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c1012 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451586:0:12908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c1012 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451593:0:12908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c1012 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726097.451605:0:8494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726097.451627:0:8494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c10f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451637:0:12908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726097.451638:0:8494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031e00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:3.0:1788726097.451644:0:8494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c10f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451646:0:12908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c1306 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451664:0:12908:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c1306 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726097.451665:0:8494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbde9110e47c10f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451675:0:12908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c1306 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788726097.451680:0:8494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbde9110e47c10f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451684:0:12908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c1306 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726097.451693:0:8494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788726097.451698:0:8494:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788726097.451702:0:12908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788726097.451708:0:12908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724000/0xcbde9110e47c0dcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c0dd4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451715:0:12908:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724000/0xcbde9110e47c0dcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c0dd4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451721:0:12908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724000/0xcbde9110e47c0dcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c0dd4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451728:0:12908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff91a10e724000/0xcbde9110e47c0dcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c0dd4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726097.451732:0:8494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c10f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.451736:0:12908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788726097.451742:0:12908:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1788726097.451743:0:8494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1788726097.451754:0:12908:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1788726097.451770:0:8494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c10f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726097.451779:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a100031e00/0xcbde9110e47c10f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c10f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788726097.451780:0:12908:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788726097.451785:0:12908:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788726097.451790:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788726097.451797:0:12908:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1788726097.451804:0:12908:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff91a13f441800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1788726097.451810:0:8494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00080000:1.0:1788726097.451811:0:12908:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff91a0052ab800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1788726097.451816:0:8494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c1012 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788726097.451820:0:12908:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff91a141afc000 a80b79b1-421f-4cd6-b6be-d8957417b61a 192.168.201.42@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1788726097.451833:0:8494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725a00 already unused, calling callback (ffffffffc1a27c20) 00000020:00080000:1.0:1788726097.451834:0:12908:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff91a103270000) has exports, disconnecting them 10000000:00010000:3.0:1788726097.451839:0:8494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c1012 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788726097.451842:0:12908:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91a13f441800), last request at 1788726096 00000020:00000080:1.0:1788726097.451852:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0fd3 00010000:00010000:3.0:1788726097.451853:0:8494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbde9110e47c1012 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788726097.451861:0:8494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbde9110e47c1012 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726097.451866:0:8494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788726097.451868:0:8494:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00080000:1.0:1788726097.451870:0:12908:0:(import.c:65:import_set_state_nolock()) ffff91a13f440000 : changing import state from FULL to CLOSED 10000000:01000000:3.0:1788726097.451871:0:8494:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788726097.451890:0:8494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c1012 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726097.451897:0:8494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788726097.451903:0:8494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c1012 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726097.451910:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e725a00/0xcbde9110e47c100b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c1012 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788726097.451914:0:12908:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91a13f441800): rc 0 00000020:00000080:1.0:1788726097.451919:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a13f441800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788726097.451929:0:12908:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91a0052ab800), last request at 1788726096 00000020:00000080:1.0:1788726097.451932:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0f47 00000100:00080000:1.0:1788726097.451938:0:12908:0:(import.c:65:import_set_state_nolock()) ffff91a0052aa000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788726097.451947:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13f441800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788726097.451989:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a13f440000 for lustre-MDT0000 00000020:00080000:1.0:1788726097.452002:0:12908:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91a0052ab800): rc 0 00000020:00000080:1.0:1788726097.452004:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a0052ab800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788726097.452015:0:12908:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb86a81c53ae0 00000020:00000080:1.0:1788726097.452026:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91a0052ab800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788726097.452047:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a0052aa000 for lustre-MDT0000 00000100:00080000:1.0:1788726097.452071:0:12908:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788726097.452076:0:12908:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788726097.452086:0:12908:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788726097.452143:0:12908:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788726097.452161:0:12908:0:(import.c:65:import_set_state_nolock()) ffff91a005174800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788726097.452172:0:12908:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788726097.452174:0:12908:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788726097.452182:0:12908:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788726097.452262:0:12908:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788726097.452270:0:12908:0:(import.c:65:import_set_state_nolock()) ffff91a111693800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788726097.452296:0:12908:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff91a103270000) has no exports 00010000:00010000:0.0:1788726097.453406:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788726097.453415:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c1306 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.453423:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10db71e00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788726097.453426:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c1306 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.453434:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbde9110e47c1306 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788726097.453440:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbde9110e47c1306 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726097.453445:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788726097.453447:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788726097.453450:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788726097.453478:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c1306 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.453484:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788726097.453504:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c1306 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.453523:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10db71e00/0xcbde9110e47c12ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c1306 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.453534:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726097.453538:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e724000/0xcbde9110e47c0dcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c0dd4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.453543:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724000 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788726097.453546:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724000/0xcbde9110e47c0dcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c0dd4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.453554:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e724000/0xcbde9110e47c0dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbde9110e47c0dd4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788726097.453560:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724000/0xcbde9110e47c0dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbde9110e47c0dd4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726097.453565:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788726097.453567:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788726097.453569:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788726097.453583:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e724000/0xcbde9110e47c0dcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c0dd4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.453589:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788726097.453596:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e724000/0xcbde9110e47c0dcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c0dd4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.453602:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e724000/0xcbde9110e47c0dcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c0dd4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.453636:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726097.453639:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726097.453640:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726097.453657:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935110784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788726097.453695:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726097.453723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726097.453779:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788726097.453785:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935110656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726097.453806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726097.453839:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935110784 00000100:00100000:0.0:1788726097.453845:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935110784 00000100:00100000:0.0:1788726097.453884:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935110656 00000100:00100000:0.0:1788726097.453888:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935110656 00000100:00100000:0.0:1788726097.453912:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788726097.453922:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+19:3307:x1875614935110784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726097.453934:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726097.453948:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100030c00/0xcbde9110e47c0dd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbde9110e47c0dcd expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.453962:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726097.453996:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+18:3307:x1875614935110784:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726097.454004:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788726097.454021:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788726097.454027:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:3307:x1875614935110656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726097.454034:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726097.454042:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10db70600/0xcbde9110e47c1306 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbde9110e47c12ff expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726097.454057:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726097.454082:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:3307:x1875614935110656:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726097.454087:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788726097.454123:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935110656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726097.454133:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935110784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726097.455696:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935110272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726097.455751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726097.455787:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788726097.455793:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935110144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726097.455813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788726097.457105:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726097.458277:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935110272 00000100:00100000:1.0:1788726097.458292:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935110272 00000100:00100000:1.0:1788726097.458360:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935110144 00000100:00100000:1.0:1788726097.458364:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935110144 00000100:00100000:1.0:1788726097.458383:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788726097.458393:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+17:3305:x1875614935110272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788726097.458407:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726097.458427:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10149aa00/0xcbde9110e47c1012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbde9110e47c100b expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.458447:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726097.458515:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+16:3305:x1875614935110272:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (2762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726097.458522:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788726097.458536:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788726097.458542:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+15:3305:x1875614935110144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788726097.458550:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726097.458559:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e724a00/0xcbde9110e47c10f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbde9110e47c10f2 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726097.458568:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726097.458603:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c72aebd-b8cf-4cbb-9509-e828aebfedcb+14:3305:x1875614935110144:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (2789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726097.458620:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788726097.459122:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935110144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726097.459134:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935110272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788726097.459367:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935110400:0@lo:9:umount.0 00000100:00100000:2.0:1788726097.459413:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726097.459455:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935110528:0@lo:9:umount.0 00000100:00100000:2.0:1788726097.459478:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726097.459998:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935110400 00000100:00100000:1.0:1788726097.460006:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935110400 00000100:00100000:1.0:1788726097.460051:0:9742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935110528 00000100:00100000:1.0:1788726097.460055:0:9742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935110528 00000100:00100000:1.0:1788726097.460126:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788726097.460237:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875614935110400:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788726097.460266:0:9742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0f55 00000100:00080000:1.0:1788726097.460277:0:9742:0:(import.c:65:import_set_state_nolock()) ffff91a13f442800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788726097.460311:0:9742:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788726097.460641:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3303:x1875614935110400:12345-0@lo:9:umount.0 Request processed in 507us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726097.460649:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788726097.460664:0:9742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788726097.460671:0:9742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875614935110528:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788726097.460683:0:9742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c103c 00000100:00080000:1.0:1788726097.460689:0:9742:0:(import.c:65:import_set_state_nolock()) ffff91a0052aa800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788726097.460708:0:9742:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:0.0:1788726097.461803:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726097.462073:0:9742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3303:x1875614935110528:12345-0@lo:9:umount.0 Request processed in 1387us (2578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726097.462083:0:9742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:2.0:1788726097.463030:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788726097.463429:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a005174800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1788726097.463447:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726097.463451:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726097.463466:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788726097.463484:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788726097.465659:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788726097.465675:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935110400:0@lo:9:umount.0 00000100:00080000:2.0:1788726097.465726:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a111693800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788726097.465743:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788726097.465745:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788726097.465748:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935110528:0@lo:9:umount.0 00000020:00080000:3.0:1788726097.473318:0:12908:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff91a103270000) has no exports 00000020:00000080:3.0:1788726097.547462:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0e28 00000020:00000080:3.0:1788726097.547481:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a110b51000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788726097.547509:0:12908:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788726097.550940:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a110b51000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788726097.550981:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788726097.551002:0:12908:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788726097.551007:0:12908:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff91a13b2619b8) has no exports 00000020:00000080:1.0:1788726097.553411:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0e21 00000020:00000080:1.0:1788726097.553423:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a13d2a9000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788726097.553502:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788726097.553514:0:12908:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788726097.553517:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a13b2ce000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788726097.553520:0:12908:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13b2ce000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788726097.553550:0:12908:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788726097.553730:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13d2a9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:3.0:1788726097.683605:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788726097.683626:0:6711:0:(genops.c:885:class_export_put()) final put ffff91a13f442000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788726097.683693:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13f442000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788726097.683748:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a13f442800 for lustre-OST0000 00010000:00010000:1.0:1788726097.941449:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788726098.745115:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a80b79b1-421f-4cd6-b6be-d8957417b61a 00000001:00080000:2.0:1788726098.745132:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788726098.745138:0:5857:0:(genops.c:885:class_export_put()) final put ffff91a141afc000/a80b79b1-421f-4cd6-b6be-d8957417b61a 00000020:00000080:1.0:1788726098.745428:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91a141afc000/a80b79b1-421f-4cd6-b6be-d8957417b61a for lustre-MDT0000 00000020:00000080:1.0:1788726098.745488:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a141afb800 for lustre-MDT0000 00000001:00100000:2.0:1788726098.748584:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788726098.748601:0:7632:0:(genops.c:885:class_export_put()) final put ffff91a1129b3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788726098.748686:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a1129b3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788726098.748901:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a0052aa800 for lustre-OST0001 00010000:00010000:0.0:1788726098.965612:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788726099.605435:0:12908:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91a1128ac180 - data ffff91a102108bd0/ffff91a004ab2c00 00000020:01000000:0.0:1788726099.605590:0:12908:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91a1070ca4e0 - data ffff91a12db88bd0/ffff91a112897c00 00000001:00000004:0.0:1788726099.618159:0:12908:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1788726099.727468:0:12908:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788726099.727474:0:12908:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788726099.727486:0:12908:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788726099.727488:0:12908:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788726099.728066:0:6698:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788726099.728071:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788726099.728081:0:6698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788726099.729105:0:12908:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788726099.729110:0:12908:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1788726099.729127:0:12908:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788726099.729129:0:12908:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788726099.729875:0:7883:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788726099.729880:0:7883:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788726099.729890:0:7883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788726099.800422:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0df0 00000020:00000080:3.0:1788726099.800437:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a139882800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788726099.802276:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0e05 00000020:00000080:3.0:1788726099.802290:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a13b2ce800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788726099.802297:0:12908:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788726099.802304:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788726099.802314:0:12908:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788726099.802318:0:12908:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff91a103274d28) has no exports 00000004:01000000:3.0:1788726099.802490:0:12908:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788726099.802498:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c1035 00000020:00000080:3.0:1788726099.802502:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a139880000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788726099.802506:0:12908:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788726099.802510:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788726099.802516:0:12908:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788726099.802518:0:12908:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff91a0061199b8) has no exports 00000020:00000080:3.0:1788726099.802524:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c102e 00000020:00000080:3.0:1788726099.802527:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a111694000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788726099.803380:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a139882800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788726099.803398:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13b2ce800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788726099.803403:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a139880000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788726099.803407:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a111694000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788726099.804397:0:12908:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788726099.804405:0:12908:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788726099.804409:0:12908:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1788726099.804416:0:12908:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788726099.804418:0:12908:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788726099.804518:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a111693800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788726099.804880:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788726099.804896:0:12908:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788726099.804901:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a006f01000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788726099.804904:0:12908:0:(genops.c:844:class_export_destroy()) destroying export ffff91a006f01000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788726099.804912:0:12908:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788726099.805005:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0ede 00000020:00000080:3.0:1788726099.805016:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a10338c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788726099.805032:0:12908:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788726099.805037:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788726099.805067:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a10338c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788726099.805491:0:12908:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788726099.805497:0:12908:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff91a11296b370) has no exports 00000020:00000080:3.0:1788726099.805506:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0ed7 00000020:00000080:3.0:1788726099.805511:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a005177800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788726099.805881:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a005177800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788726099.807069:0:12908:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788726099.807076:0:12908:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788726099.807081:0:12908:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1788726099.807088:0:12908:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788726099.807090:0:12908:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788726099.807135:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788726099.807144:0:12908:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788726099.807178:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788726099.807181:0:12908:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788726099.807186:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a139881800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788726099.807189:0:12908:0:(genops.c:844:class_export_destroy()) destroying export ffff91a139881800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788726099.807195:0:12908:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788726099.807375:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0e0c 00000020:00000080:3.0:1788726099.807392:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a13b2cd000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788726099.807398:0:12908:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788726099.807401:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788726099.807458:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a005174800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788726099.807466:0:8:0:(genops.c:885:class_export_put()) final put ffff91a13f00c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788726099.807468:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13f00c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788726099.807474:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788726099.807582:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13b2cd000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788726099.808117:0:12908:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788726099.808122:0:12908:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff91a13b260000) has no exports 00000020:00000080:3.0:1788726099.808144:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788726099.808148:0:12908:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788726099.808150:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a139886800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788726099.808152:0:12908:0:(genops.c:844:class_export_destroy()) destroying export ffff91a139886800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788726099.808157:0:12908:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788726099.809086:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0e13 00000020:00000080:3.0:1788726099.809096:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a13b2ca800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788726099.810268:0:12908:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a120292000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788726099.810276:0:12908:0:(obd_mount.c:721:lustre_put_lsi()) put ffff91a120292000 3 00000020:01000004:0.0:1788726099.810279:0:12908:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91a120292000 from lustre-MDT0000 00000020:00000080:0.0:1788726099.810308:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788726099.810318:0:12908:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788726099.810322:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a139882000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788726099.810325:0:12908:0:(genops.c:844:class_export_destroy()) destroying export ffff91a139882000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788726099.810337:0:12908:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788726099.810385:0:12908:0:(obd_mount.c:589:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788726099.810388:0:12908:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788726099.810392:0:12908:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788726099.810396:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788726099.810399:0:12908:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788726099.810405:0:12908:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff91a112870000 8c72aebd-b8cf-4cbb-9509-e828aebfedcb 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788726099.810411:0:12908:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff91a1129699b8) has exports, disconnecting them 00000020:00080000:0.0:1788726099.810415:0:12908:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff91a112870000), last request at 1788725866 00000020:00000080:0.0:1788726099.810429:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0db1 00000020:00010000:0.0:1788726099.810433:0:12908:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91a112870000: total 1 00000100:00080000:0.0:1788726099.810438:0:12908:0:(import.c:65:import_set_state_nolock()) ffff91a112871800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788726099.810455:0:12908:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91a112870000): rc 0 00000020:00080000:0.0:1788726099.810460:0:12908:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff91a1129699b8) has no exports 00000020:00010000:3.0:1788726099.810588:0:8493:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91a112870000: total 1 00010000:00010000:3.0:1788726099.810629:0:8493:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91a112870000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788726099.810668:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10db71400/0xcbde9110e47c10b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbde9110e47c10ac expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726099.810686:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10db71200/0xcbde9110e47c10c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbde9110e47c10ba expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726099.810696:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e725800/0xcbde9110e47c10cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbde9110e47c10c8 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726099.810708:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10db71a00/0xcbde9110e47c12ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbde9110e47c12e3 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726099.810717:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10db71c00/0xcbde9110e47c12f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbde9110e47c12f1 expref: 5 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726099.810731:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e724e00/0xcbde9110e47c10dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbde9110e47c10d6 expref: 4 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726099.810758:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a100031400/0xcbde9110e47c0efa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbde9110e47c0ef3 expref: 3 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726099.810771:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10db70000/0xcbde9110e47c1107 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbde9110e47c1100 expref: 2 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726099.810780:0:8493:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91a112870000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788726099.810804:0:8493:0:(genops.c:885:class_export_put()) final put ffff91a112870000/8c72aebd-b8cf-4cbb-9509-e828aebfedcb 00000100:00100000:0.0:1788726099.812306:0:5828:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff91a112959800:5828] 1 exiting: rc = 0 00000020:00000080:1.0:1788726099.813049:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13b2ca800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1788726099.813083:0:5827:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff91a1128bae00:5827] 0 exiting: rc = 1 00000020:00000080:0.0:1788726099.814608:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91a112870000/8c72aebd-b8cf-4cbb-9509-e828aebfedcb for MGS 00010000:00010000:3.0:1788726099.814631:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726099.814635:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726099.814638:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788726099.814658:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a112871800 for MGS 00000100:00100000:3.0:1788726099.814897:0:5829:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff91a112958000:5829] 2 exiting: rc = 0 00000100:00100000:0.0:1788726099.815012:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815018:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815022:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815026:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815029:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815034:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815038:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815043:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815047:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815050:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815054:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815058:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815062:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815065:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815069:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815073:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815076:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815080:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815084:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815087:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815091:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815094:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815098:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815101:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815105:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815108:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815112:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815115:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815119:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815122:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815126:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815129:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815133:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815136:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815140:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815149:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815153:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815156:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815160:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815163:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815167:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815171:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815174:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815178:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815182:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815185:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815189:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815192:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815195:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815199:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815202:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815205:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815209:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815212:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815229:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815233:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815238:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815243:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815248:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815253:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815259:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815264:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815271:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.815278:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788726099.815678:0:12908:0:(mgs_llog.c:153:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788726099.815683:0:12908:0:(mgs_llog.c:153:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788726099.817296:0:12908:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91a110f4b8a0 - data ffff91a13fc1e510/ffff91a13a9c0000 00000020:01000000:0.0:1788726099.817431:0:12908:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91a110c2f540 - data ffff91a12db0dca8/ffff91a103234000 00000020:00000080:0.0:1788726099.817960:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0d95 00000020:00000080:0.0:1788726099.817967:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a10960d000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788726099.817990:0:12908:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a120292000 from MGS, refs=2 00000020:01000004:0.0:1788726099.817993:0:12908:0:(obd_mount.c:721:lustre_put_lsi()) put ffff91a120292000 2 00000020:01000004:0.0:1788726099.817997:0:12908:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91a120292000 from MGS 00000020:00000080:0.0:1788726099.818019:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788726099.818024:0:12908:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788726099.818027:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a109609000/MGS 00000020:00000080:0.0:1788726099.818030:0:12908:0:(genops.c:844:class_export_destroy()) destroying export ffff91a109609000/MGS for MGS 00000020:01000000:0.0:1788726099.818037:0:12908:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788726099.818087:0:12908:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788726099.818091:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788726099.818096:0:12908:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788726099.818102:0:12908:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff91a139880800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788726099.818108:0:12908:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff91a1111d0000) has exports, disconnecting them 00000020:00080000:0.0:1788726099.818112:0:12908:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff91a139880800), last request at 1788725867 00000020:00000080:0.0:1788726099.818117:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0e60 00000020:00080000:0.0:1788726099.818126:0:12908:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91a139880800): rc 0 00000020:00000080:0.0:1788726099.818130:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a139880800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788726099.818820:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91a10960d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788726099.818831:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91a139880800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788726099.819266:0:12908:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788726099.819271:0:12908:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788726099.819275:0:12908:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788726099.819280:0:12908:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788726099.819316:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a104edf800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788726099.819429:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788726099.819446:0:12908:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788726099.819450:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a139883000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788726099.819453:0:12908:0:(genops.c:844:class_export_destroy()) destroying export ffff91a139883000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788726099.819458:0:12908:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788726099.819507:0:12908:0:(obd_mount.c:721:lustre_put_lsi()) put ffff91a120292000 1 00000020:00000080:1.0:1788726099.819511:0:12908:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0d87 00000020:00000080:1.0:1788726099.819516:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a10960a800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788726099.819533:0:12908:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788726099.819537:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788726099.819540:0:12908:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788726099.819543:0:12908:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff91a1032719b8) has no exports 00000020:00000080:3.0:1788726099.819581:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91a10960a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788726099.865256:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788726099.865269:0:12908:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788726099.865275:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a120290000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788726099.865279:0:12908:0:(genops.c:844:class_export_destroy()) destroying export ffff91a120290000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788726099.865290:0:12908:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788726099.865419:0:12908:0:(obd_mount.c:679:lustre_free_lsi()) Freeing lsi ffff91a120294000 00000020:01000000:3.0:1788726099.865440:0:12908:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788726099.865444:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788726099.865448:0:12908:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788726099.865452:0:12908:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff91a110b499b8) has no exports 00000100:00100000:3.0:1788726099.865536:0:5834:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff91a1110c0c00:5834] 0 exiting: rc = 1 00000100:00100000:3.0:1788726099.865643:0:7629:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff91a004a9a600:7629] 3 exiting: rc = 0 00000100:00100000:1.0:1788726099.865755:0:5835:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff91a12af27400:5835] 1 exiting: rc = 0 00000100:00100000:3.0:1788726099.867669:0:5836:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff91a110c28200:5836] 2 exiting: rc = 0 00000100:00100000:3.0:1788726099.867759:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.867778:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.867863:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.867868:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.867873:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.867879:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.867884:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.867890:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.867895:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.867901:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.867909:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.867978:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.867988:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.867994:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868000:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868006:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868011:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868017:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868022:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868028:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868033:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868038:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868043:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868049:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868055:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868061:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868067:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868072:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868077:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868082:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868088:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868094:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868099:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868105:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868110:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868116:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868121:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868134:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868139:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868144:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868150:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868156:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868163:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868168:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868174:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868180:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868186:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868191:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868197:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868202:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868208:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868231:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868239:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868245:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868250:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868255:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868260:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868266:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868271:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868277:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868283:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868288:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868294:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.868308:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879093:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff91a11033f400:5837] 0 exiting: rc = 1 00000100:00100000:0.0:1788726099.879406:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff91a11033e800:5838] 1 exiting: rc = 0 00000100:00100000:3.0:1788726099.879531:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879539:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879546:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879552:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879557:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879563:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879579:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879597:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879603:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879609:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879616:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879621:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879627:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879632:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879637:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879642:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879646:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879652:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879658:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879662:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879667:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879672:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879677:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879681:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879685:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879689:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879695:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879700:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879705:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879711:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879716:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879720:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879724:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879729:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879734:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879739:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879743:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879747:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879752:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879756:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879760:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879776:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879796:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879801:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879806:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879813:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879818:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879823:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879830:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879834:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879838:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879843:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879849:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879854:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879860:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879866:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879870:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879876:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879881:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879886:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879891:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879896:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879902:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.879907:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726099.880595:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff91a105783e00:5840] 1 exiting: rc = 0 00000100:00100000:0.0:1788726099.880745:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff91a105782400:5839] 0 exiting: rc = 1 00000100:00100000:3.0:1788726099.881067:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881073:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881081:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881087:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881100:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881115:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881120:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881125:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881147:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881157:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881170:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881181:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881275:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881308:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881314:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881326:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881333:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881338:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881346:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881361:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881398:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881408:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881414:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881423:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881428:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881435:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881441:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881447:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881452:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881458:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881463:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881470:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881492:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881500:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881506:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881512:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881519:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881525:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881531:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881536:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881542:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881547:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881553:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881559:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881589:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881596:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881602:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881607:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881619:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881626:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881631:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881637:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881642:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881648:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881654:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881660:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881680:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881692:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881698:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881704:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881711:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881717:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881723:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.881729:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.891942:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff91a105782000:5841] 0 exiting: rc = 1 00000100:00100000:1.0:1788726099.892118:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff91a105782a00:5842] 1 exiting: rc = 0 00000100:00100000:3.0:1788726099.892368:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892376:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892382:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892387:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892394:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892399:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892404:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892410:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892415:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892420:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892425:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892430:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892435:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892440:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892447:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892453:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892458:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892463:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892469:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892489:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892494:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892499:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892504:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892509:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892514:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892519:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892524:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892530:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892535:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892540:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892545:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892550:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892555:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892560:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892566:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892581:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892586:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892591:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892596:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892601:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892605:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892611:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892616:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892621:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892626:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892630:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892635:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892640:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892645:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892650:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892655:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892660:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892664:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892669:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892682:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892686:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892691:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892696:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892701:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892706:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892712:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892717:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892723:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.892727:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.893579:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff91a133645200:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1788726099.893734:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff91a110300400:5843] 0 exiting: rc = 1 00000100:00100000:3.0:1788726099.894012:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894018:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894023:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894028:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894033:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894037:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894042:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894046:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894051:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894056:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894061:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894065:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894070:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894075:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894080:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894084:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894088:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894093:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894098:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894103:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894109:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894158:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894164:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894168:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894173:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894185:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894190:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894194:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894199:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894203:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894208:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894213:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894288:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894293:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894298:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894304:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894309:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894314:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894319:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894324:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894329:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894335:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894340:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894345:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894350:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894355:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894360:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894365:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894370:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894374:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894379:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894384:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894389:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894393:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894398:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894404:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894409:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894459:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894465:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894470:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894482:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894487:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894492:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.894497:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.895192:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff91a133644800:5845] 0 exiting: rc = 1 00000100:00100000:1.0:1788726099.895342:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff91a133644600:5846] 1 exiting: rc = 0 00000100:00100000:3.0:1788726099.895433:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895439:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895444:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895448:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895453:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895457:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895462:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895467:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895472:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895477:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895482:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895487:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895492:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895498:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895503:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895508:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895513:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895519:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895524:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895529:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895535:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895539:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895908:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895980:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895986:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895991:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.895995:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896000:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896004:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896009:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896013:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896026:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896031:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896036:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896040:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896045:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896049:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896054:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896059:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896064:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896069:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896079:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896085:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896089:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896094:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896098:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896103:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896107:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896112:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896116:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896121:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896125:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896129:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896133:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896137:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896142:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896147:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896151:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896155:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896159:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896163:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896167:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896172:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.896176:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726099.896877:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff91a111799a00:5847] 0 exiting: rc = 1 00000100:00100000:0.0:1788726099.897139:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff91a133644c00:5849] 2 exiting: rc = 0 00000100:00100000:1.0:1788726099.897498:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff91a111798800:5848] 1 exiting: rc = 0 00000100:00100000:3.0:1788726099.897603:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897610:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897623:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897628:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897634:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897639:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897644:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897649:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897655:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897660:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897665:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897672:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897678:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897683:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897689:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897694:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897699:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897712:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897719:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897724:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897869:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897876:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897881:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897885:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897891:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897896:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897901:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897907:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.897912:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898018:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898027:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898032:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898037:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898042:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898048:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898052:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898057:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898068:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898073:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898078:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898083:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898100:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898106:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898110:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898115:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898120:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898125:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898130:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898135:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898141:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898146:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898152:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898156:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898161:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898166:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898171:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898178:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898187:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898193:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898198:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898203:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898209:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898282:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726099.898290:0:12908:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788726099.904303:0:12908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788726099.904315:0:12908:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788726099.904320:0:12908:0:(genops.c:885:class_export_put()) final put ffff91a11284b000/MDS_uuid 00000020:00000080:2.0:1788726099.904324:0:12908:0:(genops.c:844:class_export_destroy()) destroying export ffff91a11284b000/MDS_uuid for MDS 00000020:01000000:2.0:1788726099.904333:0:12908:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788726099.904459:0:12908:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788726099.990029:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726101.015258:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726101.206279:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935111168:0@lo:400:kworker.0 00000400:00000100:0.0:1788726101.206336:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875614935111168 offset 0 length 224: 4 00000100:00100000:3.0:1788726101.206491:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935111040:0@lo:400:kworker.0 00000400:00000100:3.0:1788726101.206516:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875614935111040 offset 0 length 224: 4 00000100:00100000:3.0:1788726101.206533:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788726101.206539:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935110912:0@lo:400:kworker.0 00000400:00000100:3.0:1788726101.206569:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875614935110912 offset 0 length 224: 4 00010000:00010000:0.0:1788726102.037825:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788726102.856947:0:13062:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788726102.876457:0:13062:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788726102.876506:0:13062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726102.876532:0:13062:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c10cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726102.876540:0:13062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c10cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726102.876547:0:13062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c10cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726102.876613:0:13062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788726102.876619:0:13062:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788726102.876644:0:13062:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788726102.876656:0:13062:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a141c48a80 x1875614935111040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726117 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726102.876674:0:13062:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788726102.876681:0:13062:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788726102.876705:0:13062:0:(import.c:65:import_set_state_nolock()) ffff91a13adc3800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788726102.878778:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935111040:0@lo:400:kworker.0 00000100:00100000:0.0:1788726102.878895:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875614935111296:0@lo:39:umount.0 00000400:00000100:0.0:1788726102.878951:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875614935111296 offset 0 length 224: 4 00010000:00010000:2.0:1788726102.882482:0:8493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726102.882498:0:8493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c10cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726102.882511:0:8493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10db71600 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:2.0:1788726102.882515:0:8493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c10cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726102.882555:0:8493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbde9110e47c10cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788726102.882564:0:8493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbde9110e47c10cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726102.882570:0:8493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788726102.882573:0:8493:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788726102.882576:0:8493:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788726102.882623:0:8493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c10cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726102.882630:0:8493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788726102.882695:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935111424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726102.882905:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788726102.882992:0:8493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c10cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726102.883000:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10db71600/0xcbde9110e47c10c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbde9110e47c10cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726102.883014:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726102.883016:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726102.883018:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726102.883633:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935111424 00000100:00100000:1.0:1788726102.883643:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935111424 00000100:00100000:1.0:1788726102.883689:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788726102.883697:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1875614935111424:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788726102.883704:0:5820:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788726102 with bad export cookie 14690338536267976113 00000100:00100000:1.0:1788726102.900910:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1875614935111424:12345-0@lo:103:ldlm_bl.0 Request processed in 17201us (17994us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788726102.900927:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788726102.901094:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.142@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788726102.901100:0:3307:0:(import.c:65:import_set_state_nolock()) ffff91a112971800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788726102.901104:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.142@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788726102.909475:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.142@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788726102.909482:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788726102.909495:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a141c49180 x1875614935110912/t0(0) o400->MGC192.168.201.142@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788726117 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726102.909583:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a141de8000 x1875614935111424/t0(0) o103->MGC192.168.201.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788726118 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788726102.909594:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788726102.909596:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788726102.909597:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788726102.909601:0:3307:0:(import.c:65:import_set_state_nolock()) ffff91a112971800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788726102.909606:0:3307:0:(import.c:510:import_select_connection()) MGC192.168.201.142@tcp: connect to NID 0@lo last attempt 161 00000100:00080000:0.0:1788726102.909615:0:3307:0:(import.c:624:import_select_connection()) MGC192.168.201.142@tcp: import ffff91a112971800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788726102.909645:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a141c48380 x1875614935111552/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788726102.909684:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3307:1875614935111424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788726102.909853:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3305:1875614935110912:0@lo:400:kworker.0 00000100:00100000:2.0:1788726102.909991:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3303:1875614935111552:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1788726102.910045:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875614935111552 offset 0 length 520: 4 00010000:00010000:3.0:1788726103.061352:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726104.085703:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726105.110688:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726106.134064:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788726106.325344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c72aebd-b8cf-4cbb-9509-e828aebfedcb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788726106.325354:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c72aebd-b8cf-4cbb-9509-e828aebfedcb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788726106.325506:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788726106.325529:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935111680:0@lo:400:kworker.0 00000400:00000100:3.0:1788726106.325587:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875614935111680 offset 0 length 224: 4 00010000:00010000:3.0:1788726107.157558:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788726107.349502:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c72aebd-b8cf-4cbb-9509-e828aebfedcb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788726107.349512:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c72aebd-b8cf-4cbb-9509-e828aebfedcb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788726107.349649:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788726107.349676:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935111808:0@lo:400:kworker.0 00000400:00000100:1.0:1788726107.349736:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875614935111808 offset 0 length 224: 4 00010000:00010000:1.0:1788726108.183234:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726109.208176:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726110.229798:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726111.254354:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726112.277891:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726112.469541:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726102/real 1788726102] req@ffff91a141c48380 x1875614935111552/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788726112 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726112.469574:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91a141c48380 x1875614935111552/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788726112 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726112.469586:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726102/real 1788726102] req@ffff91a1111d8380 x1875614935111296/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788726112 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726112.469598:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91a1111d8380 x1875614935111296/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788726112 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788726112.469613:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a112971800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788726112.469620:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788726112.469632:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3303:1875614935111552:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1788726112.469638:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a13adc3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788726112.469652:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875614935111296:0@lo:39:umount.0 00000100:00080000:3.0:1788726112.469777:0:13062:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788726112.469797:0:13062:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788726112.469801:0:13062:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788726112.470655:0:13062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726112.470668:0:13062:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c10dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726112.470677:0:13062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c10dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726112.470684:0:13062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c10dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726112.470709:0:13062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726112.470716:0:13062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c12f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726112.470723:0:13062:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c12f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726112.470729:0:13062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c12f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726112.470735:0:13062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c12f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726112.470758:0:13062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788726112.470762:0:13062:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788726112.470783:0:13062:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788726112.470787:0:13062:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788726112.470799:0:13062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788726112.470805:0:13062:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788726112.470810:0:13062:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff91a1111d19b8) has no exports 00000020:00080000:3.0:1788726112.470833:0:13062:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff91a1111d19b8) has no exports 00000020:01000000:3.0:1788726112.472441:0:13062:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91a10884c240 - data ffff91a13fc1d5e8/ffff91a005208800 00000020:01000000:3.0:1788726112.472562:0:13062:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91a102ff9de0 - data ffff91a004c8ca20/ffff91a133a7dc00 00010000:00010000:1.0:1788726112.473738:0:8493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788726112.473751:0:8493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c10dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726112.473761:0:8493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725600 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:1.0:1788726112.473766:0:8493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c10dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726112.473775:0:8493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbde9110e47c10dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788726112.473782:0:8493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbde9110e47c10dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726112.473788:0:8493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788726112.473791:0:8493:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788726112.473795:0:8493:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788726112.473813:0:8493:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91a112971800 00010000:00010000:1.0:1788726112.473829:0:8493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbde9110e47c10dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726112.473836:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e725600/0xcbde9110e47c10d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbde9110e47c10dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726112.473867:0:8493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726112.473871:0:8493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c12f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726112.473876:0:8493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921200 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:1.0:1788726112.473879:0:8493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c12f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726112.473886:0:8493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbde9110e47c12f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788726112.473892:0:8493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbde9110e47c12f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726112.473897:0:8493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788726112.473900:0:8493:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788726112.473902:0:8493:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788726112.473908:0:8493:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91a112971800 00010000:00010000:1.0:1788726112.473911:0:8493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbde9110e47c12f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726112.473917:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a108921200/0xcbde9110e47c12f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbde9110e47c12f8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726112.473925:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726112.473927:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726112.473929:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726112.474955:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788726112.475153:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c72aebd-b8cf-4cbb-9509-e828aebfedcb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788726112.475159:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788726112.475174:0:37:0:(import.c:65:import_set_state_nolock()) ffff91a112971800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788726112.475182:0:37:0:(import.c:510:import_select_connection()) MGC192.168.201.142@tcp: connect to NID 0@lo last attempt 397 00000100:00080000:2.0:1788726112.475188:0:37:0:(import.c:589:import_select_connection()) MGC192.168.201.142@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788726112.475194:0:37:0:(import.c:624:import_select_connection()) MGC192.168.201.142@tcp: import ffff91a112971800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788726112.475268:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a141de9880 x1875614935111936/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788726112.475437:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3303:1875614935111936:0@lo:250:kworker.0 00000400:00000100:0.0:1788726112.475490:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875614935111936 offset 0 length 520: 4 00000100:00100000:1.0:1788726112.475638:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788726112.475649:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935112064:0@lo:400:kworker.0 00000400:00000100:1.0:1788726112.475679:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875614935112064 offset 0 length 224: 4 00100000:10000000:3.0:1788726112.494103:0:13062:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788726112.509937:0:13062:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0f16 00000020:00000080:3.0:1788726112.509949:0:13062:0:(genops.c:885:class_export_put()) final put ffff91a13a019000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788726112.510034:0:13062:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a10338f800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788726112.510038:0:13062:0:(obd_mount.c:721:lustre_put_lsi()) put ffff91a10338f800 2 00000020:01000004:3.0:1788726112.510042:0:13062:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91a10338f800 from lustre-OST0000 00000020:00000080:3.0:1788726112.510067:0:13062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788726112.510080:0:13062:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788726112.510106:0:13062:0:(genops.c:885:class_export_put()) final put ffff91a13f00b800/lustre-OST0000_UUID 00000020:00000080:3.0:1788726112.510109:0:13062:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13f00b800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788726112.510116:0:13062:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788726112.510157:0:13062:0:(obd_mount.c:589:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788726112.510161:0:13062:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788726112.510165:0:13062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788726112.510170:0:13062:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788726112.510177:0:13062:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff91a0052ac000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788726112.510184:0:13062:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff91a11296cd28) has exports, disconnecting them 00000020:00080000:3.0:1788726112.510189:0:13062:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff91a0052ac000), last request at 1788725887 00000020:00000080:3.0:1788726112.510193:0:13062:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0f40 00000020:00080000:3.0:1788726112.510206:0:13062:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91a0052ac000): rc 0 00000020:00000080:3.0:1788726112.510210:0:13062:0:(genops.c:885:class_export_put()) final put ffff91a0052ac000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788726112.510279:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13a019000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788726112.511351:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91a0052ac000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788726112.516415:0:13062:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788726112.516424:0:13062:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788726112.516428:0:13062:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788726112.516447:0:13062:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788726112.516683:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a13adc3800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788726112.516862:0:13062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788726112.516875:0:13062:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788726112.516880:0:13062:0:(genops.c:885:class_export_put()) final put ffff91a005172800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788726112.516883:0:13062:0:(genops.c:844:class_export_destroy()) destroying export ffff91a005172800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788726112.516888:0:13062:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788726112.516939:0:13062:0:(obd_mount.c:721:lustre_put_lsi()) put ffff91a10338f800 1 00000020:00000080:3.0:1788726112.516944:0:13062:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0e9f 00000020:00000080:3.0:1788726112.516950:0:13062:0:(genops.c:885:class_export_put()) final put ffff91a141d00800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788726112.516958:0:13062:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788726112.516962:0:13062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788726112.516965:0:13062:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788726112.516969:0:13062:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff91a13b263370) has no exports 00000020:00000080:0.0:1788726112.518747:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91a141d00800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788726112.536528:0:13062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788726112.536548:0:13062:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788726112.536554:0:13062:0:(genops.c:885:class_export_put()) final put ffff91a141d03000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788726112.536560:0:13062:0:(genops.c:844:class_export_destroy()) destroying export ffff91a141d03000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788726112.536581:0:13062:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788726112.537603:0:13062:0:(obd_mount.c:679:lustre_free_lsi()) Freeing lsi ffff91a141d06800 00000020:02000400:3.0:1788726112.537652:0:13062:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788726113.301459:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726114.326383:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788726115.205853:0:13212:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788726115.225681:0:13212:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788726115.225767:0:13212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726115.225780:0:13212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c10b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726115.225787:0:13212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c10b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726115.225794:0:13212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c10b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726115.225822:0:13212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788726115.225828:0:13212:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788726115.225914:0:13212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788726115.225926:0:13212:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a141c49c00 x1875614935111168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726117 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726115.225949:0:13212:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a141c4b480 x1875614935111680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726122 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726115.225961:0:13212:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a141c49f80 x1875614935111808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726123 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726115.225975:0:13212:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a141de8a80 x1875614935112064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726128 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726115.225985:0:13212:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788726115.226020:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875614935111808:0@lo:400:kworker.0 00000100:00080000:1.0:1788726115.226067:0:13212:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788726115.226091:0:13212:0:(import.c:65:import_set_state_nolock()) ffff91a006f05000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788726115.226165:0:8493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726115.226173:0:8493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c10b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726115.226188:0:8493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724800 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788726115.226192:0:8493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c10b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726115.226201:0:8493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbde9110e47c10b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788726115.226208:0:8493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbde9110e47c10b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726115.227158:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935111168:0@lo:400:kworker.0 00000100:00100000:1.0:1788726115.227330:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935112064:0@lo:400:kworker.0 10000000:01000000:0.0:1788726115.227398:0:8493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788726115.227401:0:8493:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788726115.227404:0:8493:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788726115.227420:0:8493:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91a112971800 00010000:00010000:0.0:1788726115.227426:0:8493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbde9110e47c10b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726115.227435:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e724800/0xcbde9110e47c10ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbde9110e47c10b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726115.227451:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726115.227454:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726115.227456:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726115.227475:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875614935112192:0@lo:39:umount.0 00000400:00000100:0.0:1788726115.227639:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875614935112192 offset 0 length 224: 4 00000100:00100000:3.0:1788726115.227833:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935111680:0@lo:400:kworker.0 00010000:00010000:0.0:1788726115.349454:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726116.373395:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726117.397430:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788726117.589385:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c72aebd-b8cf-4cbb-9509-e828aebfedcb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788726117.589397:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c72aebd-b8cf-4cbb-9509-e828aebfedcb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788726118.421442:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726119.446330:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726120.469379:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726121.497270:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726122.517536:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788726122.711416:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c72aebd-b8cf-4cbb-9509-e828aebfedcb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788726122.711425:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c72aebd-b8cf-4cbb-9509-e828aebfedcb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788726123.542981:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726124.565359:0:8494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726125.462383:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726115/real 1788726115] req@ffff91a13ab4bb80 x1875614935112192/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788726125 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726125.462418:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91a13ab4bb80 x1875614935112192/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788726125 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788726125.462439:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a006f05000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788726125.462460:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875614935112192:0@lo:39:umount.0 00000100:00080000:1.0:1788726125.462602:0:13212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788726125.462607:0:13212:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788726125.462612:0:13212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788726125.463619:0:13212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c10c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726125.463634:0:13212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c10c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726125.463640:0:13212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c10c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726125.463647:0:13212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c10c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726125.463679:0:13212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788726125.463687:0:13212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c12ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726125.463694:0:13212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c12ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726125.463701:0:13212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c12ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726125.463726:0:13212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbde9110e47c12ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726125.463744:0:13212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788726125.463749:0:13212:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788726125.463775:0:13212:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788726125.463780:0:13212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788726125.463785:0:13212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788726125.463791:0:13212:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788726125.463795:0:13212:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff91a1111d3370) has no exports 00000020:00080000:1.0:1788726125.463820:0:13212:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff91a1111d3370) has no exports 00010000:00010000:0.0:1788726125.464425:0:8493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788726125.464433:0:8493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c10c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726125.464440:0:8493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10db70800 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788726125.464443:0:8493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c10c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726125.464452:0:8493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbde9110e47c10c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788726125.464460:0:8493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbde9110e47c10c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726125.464466:0:8493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788726125.464468:0:8493:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788726125.464471:0:8493:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788726125.464496:0:8493:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91a112971800 00010000:00010000:0.0:1788726125.464500:0:8493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbde9110e47c10c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726125.464506:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10db70800/0xcbde9110e47c10ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbde9110e47c10c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726125.464520:0:8493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726125.464524:0:8493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c12ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726125.464530:0:8493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a117436c00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788726125.464533:0:8493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbde9110e47c12ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726125.464539:0:8493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbde9110e47c12ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788726125.464546:0:8493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbde9110e47c12ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726125.464551:0:8493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788726125.464553:0:8493:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788726125.464555:0:8493:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788726125.464559:0:8493:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91a112971800 00010000:00010000:0.0:1788726125.464562:0:8493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbde9110e47c12ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726125.464567:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a117436c00/0xcbde9110e47c12e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbde9110e47c12ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726125.464591:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726125.464593:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726125.464595:0:8493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726125.465535:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788726125.468659:0:13212:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91a1128acea0 - data ffff91a13fcbfaf8/ffff91a110a45400 00000020:01000000:1.0:1788726125.468809:0:13212:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91a12ae148a0 - data ffff91a12545b510/ffff91a006ee8800 00100000:10000000:1.0:1788726125.481005:0:13212:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788726125.510079:0:13212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0fa2 00000020:00000080:3.0:1788726125.510091:0:13212:0:(genops.c:885:class_export_put()) final put ffff91a13f00c800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788726125.510110:0:13212:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a13adc2000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788726125.510113:0:13212:0:(obd_mount.c:721:lustre_put_lsi()) put ffff91a13adc2000 2 00000020:01000004:3.0:1788726125.510116:0:13212:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91a13adc2000 from lustre-OST0001 00000020:00000080:3.0:1788726125.510173:0:13212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788726125.510186:0:13212:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788726125.510189:0:13212:0:(genops.c:885:class_export_put()) final put ffff91a0052ae000/lustre-OST0001_UUID 00000020:00000080:3.0:1788726125.510192:0:13212:0:(genops.c:844:class_export_destroy()) destroying export ffff91a0052ae000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788726125.510199:0:13212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788726125.510330:0:13212:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8c72aebd-b8cf-4cbb-9509-e828aebfedcb->MGS 00010000:00010000:3.0:1788726125.510345:0:13212:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10db71800/0xcbde9110e47c0ef3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbde9110e47c0efa expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788726125.510585:0:13212:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10db71800/0xcbde9110e47c0ef3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbde9110e47c0efa expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726125.510592:0:13212:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788726125.510595:0:13212:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788726125.510599:0:13212:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788726125.510615:0:13212:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91a112971800 00010000:00010000:3.0:1788726125.510618:0:13212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10db71800/0xcbde9110e47c0ef3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbde9110e47c0efa expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726125.510632:0:13212:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c1100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbde9110e47c1107 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788726125.510639:0:13212:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c1100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbde9110e47c1107 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726125.510644:0:13212:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788726125.510646:0:13212:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788726125.510647:0:13212:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788726125.510654:0:13212:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91a112971800 00010000:00010000:3.0:1788726125.510656:0:13212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a100031600/0xcbde9110e47c1100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbde9110e47c1107 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788726125.510684:0:13212:0:(import.c:65:import_set_state_nolock()) ffff91a112971800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788726125.510688:0:13212:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788726125.510690:0:13212:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788726125.510691:0:13212:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788726125.510695:0:13212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788726125.510706:0:13212:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91a141de9880 x1875614935111936/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788726127 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788726125.510731:0:13212:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788726125.510734:0:13212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:0.0:1788726125.510803:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13f00c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788726125.510878:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c72aebd-b8cf-4cbb-9509-e828aebfedcb:3303:1875614935111936:0@lo:250:kworker.0 10000000:01000000:3.0:1788726125.511336:0:13212:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788726125.511345:0:13212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0da3 00000020:00000080:3.0:1788726125.511361:0:13212:0:(genops.c:885:class_export_put()) final put ffff91a11284e800/8c72aebd-b8cf-4cbb-9509-e828aebfedcb 00000020:01000000:3.0:1788726125.511375:0:13212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.142@tcp (flags='') 00000020:00000080:3.0:1788726125.511382:0:13212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788726125.511388:0:13212:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.142@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788726125.511392:0:13212:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff91a103273370) has no exports 00000020:00000080:0.0:1788726125.511433:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91a11284e800/8c72aebd-b8cf-4cbb-9509-e828aebfedcb for MGC192.168.201.142@tcp 10000000:01000000:1.0:1788726125.513412:0:5831:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788726125.513871:0:13212:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.142@tcp: client import never connected 00000100:00080000:3.0:1788726125.513877:0:13212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788726125.513881:0:13212:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788726125.513884:0:13212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788726125.513886:0:13212:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788726125.513956:0:13212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788726125.513968:0:13212:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.142@tcp (uuid 8c72aebd-b8cf-4cbb-9509-e828aebfedcb) 00000020:01000000:3.0:1788726125.513976:0:13212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788726125.513984:0:13212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788726125.513990:0:13212:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788726125.513997:0:13212:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff91a006f06800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788726125.514004:0:13212:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff91a110b4b370) has exports, disconnecting them 00000020:00080000:3.0:1788726125.514008:0:13212:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff91a006f06800), last request at 1788725906 00000020:00000080:3.0:1788726125.514013:0:13212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0fcc 00000020:00080000:3.0:1788726125.514045:0:13212:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91a006f06800): rc 0 00000020:00000080:3.0:1788726125.514049:0:13212:0:(genops.c:885:class_export_put()) final put ffff91a006f06800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788726125.514774:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a112971800 for MGC192.168.201.142@tcp 00000020:00000080:0.0:1788726125.514784:0:36:0:(genops.c:885:class_export_put()) final put ffff91a112977800/8c72aebd-b8cf-4cbb-9509-e828aebfedcb 00000020:00000080:0.0:1788726125.514787:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91a112977800/8c72aebd-b8cf-4cbb-9509-e828aebfedcb for MGC192.168.201.142@tcp 00000020:01000000:0.0:1788726125.514793:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.142@tcp (8c72aebd-b8cf-4cbb-9509-e828aebfedcb) 00000020:00000080:0.0:1788726125.515029:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91a006f06800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788726125.523462:0:13212:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788726125.523472:0:13212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788726125.523476:0:13212:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788726125.523483:0:13212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788726125.523550:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1788726125.523704:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91a006f05000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788726125.527377:0:8494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788726125.527625:0:8493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1788726125.527749:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1788726125.527888:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff91a12aface00:5816] 0 exiting: rc = 1 00000100:00100000:0.0:1788726125.527974:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff91a120274a00:5817] 1 exiting: rc = 0 00000100:00100000:1.0:1788726125.528063:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.528375:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff91a112a10c00:5820] 2 exiting: rc = 0 00000100:00100000:0.0:1788726125.528532:0:8495:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff91a1055d7000:8495] 3 exiting: rc = 0 00000100:00100000:0.0:1788726125.528587:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff91a120274000:5819] 1 exiting: rc = 0 00000100:00100000:0.0:1788726125.528633:0:8496:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff91a11161a000:8496] 4 exiting: rc = 0 00000100:00100000:2.0:1788726125.535199:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff91a120275000:5818] 0 exiting: rc = 1 00000100:00100000:1.0:1788726125.535480:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535489:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535494:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535501:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535513:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535520:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535527:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535534:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535540:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535559:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535564:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535570:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535576:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535582:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535588:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535594:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535601:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535606:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535611:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535616:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535621:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535628:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535633:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535638:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535644:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535649:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535653:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535657:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535662:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535666:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535671:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535676:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535680:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535685:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535689:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535693:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535698:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535702:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535707:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535712:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535717:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535721:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535726:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535731:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535744:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535750:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535755:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535760:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535765:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535770:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535775:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535780:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535785:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535790:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535795:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535801:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535807:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535812:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535818:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535823:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535828:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535832:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535849:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.535855:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788726125.537818:0:13212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788726125.537831:0:13212:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788726125.537838:0:13212:0:(genops.c:885:class_export_put()) final put ffff91a006f06000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788726125.537842:0:13212:0:(genops.c:844:class_export_destroy()) destroying export ffff91a006f06000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788726125.537848:0:13212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788726125.537900:0:13212:0:(obd_mount.c:721:lustre_put_lsi()) put ffff91a13adc2000 1 00000020:00000080:1.0:1788726125.537907:0:13212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbde9110e47c0f71 00000020:00000080:1.0:1788726125.537913:0:13212:0:(genops.c:885:class_export_put()) final put ffff91a11169f000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788726125.537932:0:13212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788726125.537937:0:13212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788726125.537941:0:13212:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788726125.537945:0:13212:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff91a112968000) has no exports 00000020:00000080:0.0:1788726125.538872:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91a11169f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788726125.570429:0:13212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788726125.570444:0:13212:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788726125.570450:0:13212:0:(genops.c:885:class_export_put()) final put ffff91a13adc2800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788726125.570455:0:13212:0:(genops.c:844:class_export_destroy()) destroying export ffff91a13adc2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788726125.570482:0:13212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788726125.570647:0:13212:0:(obd_mount.c:679:lustre_free_lsi()) Freeing lsi ffff91a13adc4000 00000020:01000000:0.0:1788726125.570679:0:13212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788726125.570685:0:13212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788726125.570690:0:13212:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788726125.570694:0:13212:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff91a13b264d28) has no exports 00000020:00000080:0.0:1788726125.570716:0:13212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788726125.570721:0:13212:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788726125.570724:0:13212:0:(genops.c:885:class_export_put()) final put ffff91a141d07000/OSS_uuid 00000020:00000080:0.0:1788726125.570726:0:13212:0:(genops.c:844:class_export_destroy()) destroying export ffff91a141d07000/OSS_uuid for OSS 00000020:01000000:0.0:1788726125.570729:0:13212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788726125.570818:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff91a139f4d600:6680] 0 exiting: rc = 1 00000100:00100000:1.0:1788726125.571190:0:9742:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff91a13ad8dc00:9742] 3 exiting: rc = 0 00000100:00080000:3.0:1788726125.572098:0:5830:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788726125.573977:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff91a139f4ce00:6683] 2 exiting: rc = 0 00000100:00100000:2.0:1788726125.574208:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff91a112bd6c00:6682] 1 exiting: rc = 0 00000100:00100000:0.0:1788726125.575010:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575019:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575024:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575030:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575035:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575040:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575047:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575052:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575058:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575063:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575067:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575072:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575077:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575082:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575087:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575092:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575097:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575103:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575108:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575113:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575119:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575124:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575154:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575159:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575172:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575178:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575182:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575187:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575192:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575198:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575203:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575208:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575213:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575316:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575322:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575327:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575332:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575337:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575342:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575359:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575365:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575370:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575375:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575379:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575384:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575388:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575393:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575398:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575403:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575408:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575413:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575418:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575423:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575428:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575433:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575437:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575442:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575454:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575459:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575463:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575468:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575473:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575477:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.575482:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788726125.584118:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff91a139f4d000:6684] 0 exiting: rc = 1 00000100:00100000:3.0:1788726125.584561:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff91a109662000:6685] 1 exiting: rc = 0 00000100:00100000:1.0:1788726125.584879:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584900:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584905:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584910:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584915:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584921:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584926:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584931:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584937:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584942:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584947:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584952:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584957:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584961:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584966:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584971:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584976:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584980:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584985:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584990:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.584996:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585001:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585005:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585010:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585015:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585020:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585024:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585030:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585035:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585040:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585045:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585050:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585056:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585061:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585066:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585070:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585081:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585087:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585092:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585097:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585102:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585107:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585112:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585117:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585122:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585127:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585132:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585148:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585154:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585159:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585820:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585834:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585839:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585844:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585850:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585855:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585860:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585867:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585873:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585879:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585884:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585890:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585894:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.585900:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.591131:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff91a13b078c00:6686] 0 exiting: rc = 1 00000100:00100000:3.0:1788726125.591502:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff91a139b2a600:6688] 2 exiting: rc = 0 00000100:00100000:0.0:1788726125.592864:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff91a139b2a800:6687] 1 exiting: rc = 0 00000100:00100000:1.0:1788726125.593308:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593316:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593322:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593329:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593334:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593340:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593429:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593434:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593440:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593445:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593451:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593457:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593463:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593471:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593476:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593482:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593487:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593493:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593499:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593518:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593524:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593530:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593536:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593541:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593546:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593552:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593558:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593563:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593569:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593575:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593581:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593587:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593593:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593599:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593605:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593610:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593616:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593621:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593628:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593635:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593640:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593654:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593661:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593666:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593672:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593678:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593685:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593691:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593713:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593720:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593726:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593733:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593739:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593745:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593750:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593756:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593763:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593769:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593775:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593780:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593797:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593807:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593813:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.593819:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.601036:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff91a139b32c00:6690] 1 exiting: rc = 0 00000100:00100000:2.0:1788726125.601615:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff91a139b31000:6689] 0 exiting: rc = 1 00000100:00100000:1.0:1788726125.601784:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601791:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601797:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601802:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601808:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601813:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601818:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601824:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601829:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601834:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601839:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601845:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601864:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601870:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601875:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601881:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601886:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601891:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601896:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601902:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601906:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601911:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601917:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601922:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601927:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601932:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601938:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601943:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601948:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601953:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601958:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601981:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601987:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601992:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.601997:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602003:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602008:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602013:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602018:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602023:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602028:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602033:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602038:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602043:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602048:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602053:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602058:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602069:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602074:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602079:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602085:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602089:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602094:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602099:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602104:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602108:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602113:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602118:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602123:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602128:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602133:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602149:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602155:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.602161:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726125.603520:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff91a11110b400:6692] 1 exiting: rc = 0 00000100:00100000:2.0:1788726125.603951:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff91a139b32e00:6691] 0 exiting: rc = 1 00000100:00100000:0.0:1788726125.606358:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606369:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606375:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606382:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606388:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606393:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606399:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606405:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606411:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606418:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606424:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606437:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606447:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606453:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606459:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606465:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606470:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606476:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606482:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606488:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606493:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606498:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606504:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606523:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606529:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606535:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606552:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606560:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606567:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606575:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606582:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606589:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606595:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606601:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606608:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606626:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606633:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606639:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606646:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606652:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606658:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606664:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606672:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606678:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606684:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606690:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606699:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606715:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606722:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606728:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606734:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606740:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606745:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606751:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606758:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606763:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606769:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606775:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606782:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606810:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606818:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606828:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606834:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726125.606841:0:13212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788726125.616894:0:13212:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788726145.439566:0:13834:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788726154.045397:0:14295:0:(obd_mount.c:934:lmd_print()) mount data: 00000020:01000004:0.0:1788726154.045402:0:14295:0:(obd_mount.c:937:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788726154.045518:0:14295:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91a13ad4c800 00000020:01000004:0.0:1788726154.045534:0:14295:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788726154.045542:0:14295:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788726154.045557:0:14295:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff91a00611b370) 00000020:00000080:0.0:1788726154.045570:0:14295:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788726154.070766:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788726154.075549:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788726154.076202:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 379: rc = 0 00100000:10000000:2.0:1788726154.076411:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 379: rc = 0 00100000:10000000:2.0:1788726154.076504:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 379: rc = 0 00100000:10000000:2.0:1788726154.076564:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 379: rc = 0 00100000:10000000:2.0:1788726154.076623:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 379: rc = 0 00100000:10000000:2.0:1788726154.076809:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788726154.077118:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 379: rc = 0 00100000:10000000:2.0:1788726154.077535:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 381: rc = 0 00100000:10000000:2.0:1788726154.081306:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 635: rc = 0 00100000:10000000:2.0:1788726154.081412:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 635: rc = 0 00100000:10000000:2.0:1788726154.087265:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 400: rc = 0 00100000:10000000:2.0:1788726154.087636:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 400: rc = 0 00100000:10000000:2.0:1788726154.093677:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 400: rc = 0 00100000:10000000:2.0:1788726154.094643:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 400: rc = 0 00100000:10000000:2.0:1788726154.098390:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 400: rc = 0 00100000:10000000:2.0:1788726154.098669:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 400: rc = 0 00100000:10000000:2.0:1788726154.100805:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 400: rc = 0 00100000:10000000:2.0:1788726154.101107:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 400: rc = 0 00100000:10000000:2.0:1788726154.103794:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 400: rc = 0 00100000:10000000:2.0:1788726154.104496:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 400: rc = 0 00100000:10000000:2.0:1788726154.104781:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 400: rc = 0 00100000:10000000:2.0:1788726154.105376:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 400: rc = 0 00100000:10000000:2.0:1788726154.105803:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 103: rc = 0 00100000:10000000:2.0:1788726154.106641:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 103: rc = 0 00100000:10000000:2.0:1788726154.107341:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 103: rc = 0 00100000:10000000:2.0:1788726154.107602:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 103: rc = 0 00100000:10000000:2.0:1788726154.108442:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 103: rc = 0 00100000:10000000:2.0:1788726154.108746:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 103: rc = 0 00100000:10000000:2.0:1788726154.109490:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 103: rc = 0 00100000:10000000:2.0:1788726154.109807:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 103: rc = 0 00100000:10000000:2.0:1788726154.110380:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 103: rc = 0 00100000:10000000:2.0:1788726154.110644:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 103: rc = 0 00100000:10000000:2.0:1788726154.111601:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 103: rc = 0 00100000:10000000:2.0:1788726154.111862:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 103: rc = 0 00100000:10000000:2.0:1788726154.112115:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 103: rc = 0 00100000:10000000:2.0:1788726154.112624:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 103: rc = 0 00100000:10000000:2.0:1788726154.112882:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 103: rc = 0 00100000:10000000:2.0:1788726154.113487:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 103: rc = 0 00100000:10000000:2.0:1788726154.113819:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 103: rc = 0 00100000:10000000:2.0:1788726154.114066:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 103: rc = 0 00100000:10000000:2.0:1788726154.114467:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 103: rc = 0 00100000:10000000:2.0:1788726154.119059:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 103: rc = 0 00100000:10000000:2.0:1788726154.119649:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 103: rc = 0 00100000:10000000:3.0:1788726154.120386:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 103: rc = 0 00100000:10000000:3.0:1788726154.120626:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 103: rc = 0 00100000:10000000:3.0:1788726154.121349:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 103: rc = 0 00100000:10000000:3.0:1788726154.121612:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 103: rc = 0 00100000:10000000:3.0:1788726154.123866:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 103: rc = 0 00100000:10000000:3.0:1788726154.124321:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 103: rc = 0 00100000:10000000:3.0:1788726154.124557:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 103: rc = 0 00100000:10000000:3.0:1788726154.124805:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 103: rc = 0 00100000:10000000:3.0:1788726154.126132:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 103: rc = 0 00100000:10000000:3.0:1788726154.126425:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 103: rc = 0 00100000:10000000:3.0:1788726154.128609:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 103: rc = 0 00100000:10000000:3.0:1788726154.129600:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 92: rc = 0 00100000:10000000:3.0:1788726154.130379:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788726154.130542:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 636: rc = 0 00100000:10000000:3.0:1788726154.131140:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788726154.131257:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 636: rc = 0 00100000:10000000:3.0:1788726154.131456:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788726154.131512:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 636: rc = 0 00100000:10000000:3.0:1788726154.131856:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788726154.135998:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 638: rc = 0 00100000:10000000:3.0:1788726154.136325:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788726154.136404:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 638: rc = 0 00100000:10000000:3.0:1788726154.136583:0:14295:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788726154.136648:0:14295:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 638: rc = 0 00000020:00000080:3.0:1788726154.137300:0:14295:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788726154.137309:0:14295:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788726154.137320:0:14295:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbde9110e47c2096 00000020:01000004:3.0:1788726154.137329:0:14295:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788726154.137334:0:14295:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788726154.137340:0:14295:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91a13ad4c800 from MGS 00000020:01000004:3.0:1788726154.137345:0:14295:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788726154.137355:0:14295:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff91a110b4cd28) 00000020:00000080:3.0:1788726154.137366:0:14295:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788726154.137420:0:14295:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a13ad4c800 from MGS, refs=2 00080000:01000000:3.0:1788726154.137424:0:14295:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788726154.137430:0:14295:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbde9110e47c20a4 00000100:00100000:3.0:1788726154.137515:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788726154.137641:0:14295:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788726154.137648:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788726154.149831:0:14295:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788726154.149845:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788726154.150716:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788726154.150903:0:14295:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788726154.150908:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788726154.152286:0:14295:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788726154.152296:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788726154.152615:0:14295:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788726154.152620:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788726154.153806:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726154.153810:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726154.153812:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726154.155380:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726154.155386:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726154.155388:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726154.156838:0:14295:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788726154.166132:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788726154.179040:0:14295:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788726154.179058:0:14295:0:(mgs_llog.c:153:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788726154.179060:0:14295:0:(mgs_llog.c:153:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788726154.184504:0:14304:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788726154.184728:0:14295:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788726154.184846:0:14295:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788726154.185409:0:14295:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788726154.185789:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788726154.185975:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788726154.185982:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788726154.199601:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788726154.199621:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788726154.200146:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788726154.200153:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788726154.201281:0:14295:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788726154.201306:0:14295:0:(obd_mount.c:422:lustre_start_mgc()) Start MGC 'MGC192.168.201.142@tcp' 00000020:01000004:3.0:1788726154.201308:0:14295:0:(obd_mount.c:431:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788726154.201338:0:14295:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD MGC192.168.201.142@tcp (typ=mgc) 00000020:00000080:3.0:1788726154.201351:0:14295:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.142@tcp (ffff91a110b48000) 00000020:00000080:3.0:1788726154.201366:0:14295:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788726154.201442:0:14295:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a00709f800@MGC192.168.201.142@tcp: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788726154.201589:0:14295:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.142@tcp-0 is initialized 00000040:01000000:3.0:1788726154.201595:0:14295:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788726154.202064:0:14309:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788726154.203135:0:14310:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788726154.203207:0:14295:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.142@tcp (uuid 76a859c7-cdbc-4bb3-9a70-48c81e8748a1) 00000020:00000080:2.0:1788726154.213249:0:14295:0:(genops.c:1385:class_connect()) connect: client 76a859c7-cdbc-4bb3-9a70-48c81e8748a1, cookie 0xcbde9110e47c20b2 00000100:00080000:2.0:1788726154.213269:0:14295:0:(import.c:510:import_select_connection()) MGC192.168.201.142@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788726154.213277:0:14295:0:(import.c:624:import_select_connection()) MGC192.168.201.142@tcp: import ffff91a00709f800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788726154.213313:0:14295:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a141de9180 x1875614935112320/t0(0) o250->MGC192.168.201.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788726154.213345:0:14295:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 76a859c7-cdbc-4bb3-9a70-48c81e8748a1->MGS 00000020:01000004:2.0:1788726154.213369:0:14295:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788726154.213376:0:14295:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788726154.213391:0:14295:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff91a13b264d28) 00000020:00000080:2.0:1788726154.213403:0:14295:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788726154.214019:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3303:1875614935112320:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788726154.214088:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726154.223644:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935112320 00000100:00100000:0.0:1788726154.223670:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935112320 00000100:00100000:0.0:1788726154.223733:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788726154.223742:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1875614935112320:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788726154.223767:0:14305:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 76a859c7-cdbc-4bb3-9a70-48c81e8748a1@0@lo t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:0.0:1788726154.223813:0:14305:0:(genops.c:1385:class_connect()) connect: client 76a859c7-cdbc-4bb3-9a70-48c81e8748a1, cookie 0xcbde9110e47c20c0 00000100:00080000:0.0:1788726154.223967:0:14305:0:(import.c:65:import_set_state_nolock()) ffff91a005171800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788726154.224058:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+5:3303:x1875614935112320:12345-0@lo:250:mount.lustre.0 Request processed in 316us (9969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726154.224078:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788726154.224134:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.142@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788726154.224143:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.142@tcp: connect to target with instance 0 00000100:00080000:0.0:1788726154.224151:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.142@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788726154.224156:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788726154.224159:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a00709f800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788726154.224162:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788726154.224185:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788726154.224191:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3303:1875614935112320:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788726154.236398:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788726154.236599:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788726154.236606:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788726154.256590:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788726154.256603:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788726154.257083:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788726154.257091:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788726154.257783:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788726154.258072:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788726154.258077:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788726154.268794:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788726154.273497:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788726154.337504:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788726154.337758:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788726154.337766:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788726154.340964:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788726154.340978:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788726154.343891:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788726154.344085:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788726154.344091:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788726154.347498:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788726154.347512:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788726154.350804:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788726154.351006:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788726154.351012:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788726154.356179:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788726154.356192:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788726154.357911:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788726154.358088:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788726154.358094:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788726154.359692:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788726154.359703:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788726154.391752:0:14295:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788726154.391960:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788726154.391966:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788726154.393679:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788726154.393691:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788726154.398839:0:14295:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788726154.398856:0:14295:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788726154.399762:0:14295:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788726154.399786:0:14295:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788726154.399792:0:14295:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788726154.399935:0:14295:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788726154.399968:0:14295:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.142@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788726154.399972:0:14295:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788726154.399974:0:14295:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788726154.399976:0:14295:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788726154.399977:0:14295:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788726154.399978:0:14295:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788726154.399980:0:14295:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788726154.399982:0:14295:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788726154.399983:0:14295:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788726154.399985:0:14295:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788726154.399986:0:14295:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788726154.399993:0:14295:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788726154.399996:0:14295:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788726154.399997:0:14295:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788726154.399998:0:14295:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788726154.399999:0:14295:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788726154.400000:0:14295:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788726154.400001:0:14295:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788726154.400002:0:14295:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788726154.400003:0:14295:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788726154.400004:0:14295:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788726154.400005:0:14295:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788726154.400030:0:14295:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788726154.400048:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935112448:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788726154.400116:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726154.400211:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a107ef7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788726154.400604:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935112448 00000100:00100000:3.0:1788726154.400612:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935112448 00000100:00100000:3.0:1788726154.400669:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788726154.400678:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+5:14295:x1875614935112448:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788726154.400731:0:14308:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788726154.400734:0:14308:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788726154.400736:0:14308:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788726154.401343:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788726154.401717:0:14308:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788726154.403262:0:14330:0:(mgs_llog.c:343:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788726154.403269:0:14330:0:(mgs_llog.c:327:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788726154.403272:0:14330:0:(mgs_llog.c:327:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788726154.403308:0:14330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788726154.403725:0:14308:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788726154.403736:0:14308:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788726154.413090:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+5:14295:x1875614935112448:12345-0@lo:253:mount.lustre.0 Request processed in 12403us (12964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726154.413107:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788726154.413124:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935112448:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788726154.413140:0:14295:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788726154.413143:0:14295:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788726154.413144:0:14295:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788726154.413146:0:14295:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788726154.413147:0:14295:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788726154.413148:0:14295:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788726154.413149:0:14295:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788726154.413151:0:14295:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788726154.413152:0:14295:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788726154.413154:0:14295:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788726154.413156:0:14295:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788726154.413173:0:14295:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91a13ad4c800 from lustre-MDT0000 10000000:01000000:0.0:1788726154.413201:0:14295:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788726154.413204:0:14295:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788726154.413208:0:14295:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91a110b48000 10000000:01000000:0.0:1788726154.413212:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788726154.413239:0:14295:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91a110b48000 from 1 10000000:01000000:0.0:1788726154.413243:0:14295:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788726154.413283:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c20c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.413307:0:14295:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c20c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.413318:0:14295:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c20c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726154.413340:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935112576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788726154.413374:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726154.413407:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a107ef7480 going to sleep for 11 seconds 00000100:00100000:3.0:1788726154.413415:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935112576 00000100:00100000:3.0:1788726154.413421:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935112576 00000100:00100000:3.0:1788726154.413464:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788726154.413473:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+5:14295:x1875614935112576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788726154.413484:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726154.413498:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a13a915a00/0xcbde9110e47c20ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c20c7 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.413522:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a13a915a00/0xcbde9110e47c20ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c20c7 expref: 6 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.413532:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a13a915a00/0xcbde9110e47c20ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c20c7 expref: 6 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.413540:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915a00, rc 0) 00000100:00100000:3.0:1788726154.413583:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+6:14295:x1875614935112576:12345-0@lo:101:mount.lustre.0 Request processed in 112us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726154.413590:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788726154.413729:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935112576:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726154.413742:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c20c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c20ce expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.413752:0:14295:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c20c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c20ce expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726154.413796:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141dea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935112704:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726154.413822:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726154.413843:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12ad72600 going to sleep for 11 seconds 00000100:00100000:3.0:1788726154.414012:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935112704 00000100:00100000:3.0:1788726154.414017:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935112704 00000100:00100000:3.0:1788726154.414057:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788726154.414064:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+6:14295:x1875614935112704:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726154.414975:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+6:14295:x1875614935112704:12345-0@lo:501:mount.lustre.0 Request processed in 908us (1148us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788726154.414985:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788726154.415010:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141dea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935112704:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788726154.415041:0:14295:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788726154.415059:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c20c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c20ce expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.415068:0:14295:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c20c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c20ce expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726154.415076:0:14295:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91a13ad4c800 10000000:01000000:2.0:1788726154.415081:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788726154.415086:0:14295:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91a13ad4c800 10000000:01000000:2.0:1788726154.415088:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788726154.415091:0:14295:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91a13ad4c800 from 1 10000000:01000000:2.0:1788726154.415093:0:14295:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788726154.415130:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a1398eb200/0xcbde9110e47c20d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.415139:0:14295:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a1398eb200/0xcbde9110e47c20d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.415147:0:14295:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a1398eb200/0xcbde9110e47c20d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726154.415162:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141dea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935112832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788726154.415193:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726154.415247:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12ad72600 going to sleep for 11 seconds 00000100:00100000:3.0:1788726154.416317:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935112832 00000100:00100000:3.0:1788726154.416327:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935112832 00000100:00100000:3.0:1788726154.416384:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788726154.416393:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+6:14295:x1875614935112832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788726154.416408:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726154.416424:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a13a915000/0xcbde9110e47c20dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c20d5 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.416446:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a13a915000/0xcbde9110e47c20dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c20d5 expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.416456:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a13a915000/0xcbde9110e47c20dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c20d5 expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.416466:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a915000, rc 0) 00000100:00100000:3.0:1788726154.416521:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+7:14295:x1875614935112832:12345-0@lo:101:mount.lustre.0 Request processed in 129us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726154.416528:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788726154.416637:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141dea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935112832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726154.416664:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a1398eb200/0xcbde9110e47c20d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c20dc expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.416675:0:14295:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a1398eb200/0xcbde9110e47c20d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c20dc expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726154.416694:0:14295:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788726154.416713:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a1398eb200/0xcbde9110e47c20d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c20dc expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.416722:0:14295:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a1398eb200/0xcbde9110e47c20d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c20dc expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726154.416730:0:14295:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788726154.416734:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788726154.416739:0:14295:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91a13ad4c800 10000000:01000000:2.0:1788726154.416751:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788726154.416755:0:14295:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788726154.416758:0:14295:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788726154.416777:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a1398eae00/0xcbde9110e47c20e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.416786:0:14295:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a1398eae00/0xcbde9110e47c20e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.416794:0:14295:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a1398eae00/0xcbde9110e47c20e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726154.416812:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141dea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935112960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788726154.416845:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726154.416870:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12ad72600 going to sleep for 11 seconds 00000100:00100000:0.0:1788726154.416943:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935112960 00000100:00100000:0.0:1788726154.416949:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935112960 00000100:00100000:0.0:1788726154.416984:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788726154.416991:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+7:14295:x1875614935112960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726154.416999:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726154.417009:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e724a00/0xcbde9110e47c20ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c20e3 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.417022:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e724a00/0xcbde9110e47c20ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c20e3 expref: 8 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.417031:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e724a00/0xcbde9110e47c20ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c20e3 expref: 8 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.417037:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724a00, rc 0) 00000100:00100000:0.0:1788726154.417076:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+8:14295:x1875614935112960:12345-0@lo:101:mount.lustre.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726154.417083:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788726154.417194:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141dea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935112960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788726154.417204:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a1398eae00/0xcbde9110e47c20e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c20ea expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.417252:0:14295:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a1398eae00/0xcbde9110e47c20e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c20ea expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726154.417309:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935113088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726154.417335:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726154.417361:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a11044b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726154.417387:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935113088 00000100:00100000:2.0:1788726154.417392:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935113088 00000100:00100000:2.0:1788726154.417422:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788726154.417428:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+8:14295:x1875614935113088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726154.417843:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+9:14295:x1875614935113088:12345-0@lo:501:mount.lustre.0 Request processed in 414us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726154.417850:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788726154.418304:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935113088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726154.418335:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935113216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788726154.418373:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726154.418394:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a11044b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726154.418702:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935113216 00000100:00100000:2.0:1788726154.418709:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935113216 00000100:00100000:2.0:1788726154.418751:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788726154.418758:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+9:14295:x1875614935113216:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788726154.419111:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+9:14295:x1875614935113216:12345-0@lo:503:mount.lustre.0 Request processed in 351us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726154.419128:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788726154.419371:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935113216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788726154.420394:0:14331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14331:1875614935113344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788726154.420455:0:14331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726154.420498:0:14331:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a11044bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726154.423798:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935113344 00000100:00100000:0.0:1788726154.423815:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935113344 00000100:00100000:0.0:1788726154.423889:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788726154.423900:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+9:14331:x1875614935113344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788726154.424332:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+9:14331:x1875614935113344:12345-0@lo:502:llog_process_th.0 Request processed in 433us (3875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726154.424341:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788726154.424388:0:14331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14331:1875614935113344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788726154.424427:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788726154.424438:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726154.424441:0:14331:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788726154.424445:0:14331:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788726154.424448:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788726154.424464:0:14331:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff91a110b4b370) 00000020:00000080:3.0:1788726154.424485:0:14331:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788726154.424491:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788726154.424566:0:14331:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788726154.424572:0:14331:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbde9110e47c20f8 00000020:00000080:3.0:1788726154.424802:0:14331:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788726154.424807:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788726154.424810:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726154.424817:0:14331:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788726154.424820:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788726154.424824:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726154.424825:0:14331:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788726154.424829:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788726154.424837:0:14331:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff91a110b499b8) 00000020:00000080:3.0:1788726154.424846:0:14331:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788726154.424850:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788726154.424852:0:14331:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788726154.424855:0:14331:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788726154.424935:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788726154.424977:0:14331:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a13ad4c800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788726154.424992:0:14331:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff91a103273370) 00000020:00000080:3.0:1788726154.425001:0:14331:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788726154.425046:0:14331:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788726154.425051:0:14331:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbde9110e47c210d 00000020:00000080:3.0:1788726154.425364:0:14331:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788726154.425371:0:14331:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788726154.425376:0:14331:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcbde9110e47c2114 00080000:01000000:3.0:1788726154.425381:0:14331:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788726154.425384:0:14331:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbde9110e47c211b 00010000:00010000:2.0:1788726154.495984:0:14331:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788726154.496511:0:14331:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788726154.496833:0:14331:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788726154.497517:0:14331:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff91a13b263370) 00000020:00000080:2.0:1788726154.497535:0:14331:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788726154.497609:0:14331:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788726154.497616:0:14331:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbde9110e47c2129 00000020:00000080:3.0:1788726154.498308:0:14331:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788726154.501402:0:14331:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcbde9110e47c2130 00000020:00000080:3.0:1788726154.504322:0:14331:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788726154.504336:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788726154.504344:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726154.504346:0:14331:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788726154.504350:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788726154.504353:0:14331:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788726154.504355:0:14331:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788726154.504356:0:14331:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788726154.504357:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788726154.504360:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726154.504361:0:14331:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788726154.504373:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788726154.504378:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726154.504379:0:14331:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788726154.504384:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788726154.504547:0:14331:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788726154.504563:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788726154.504567:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726154.504569:0:14331:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788726154.504572:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788726154.504576:0:14331:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788726154.504578:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726154.504580:0:14331:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788726154.504583:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788726154.504588:0:14331:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:01000000:3.0:1788726154.504615:0:14331:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788726154.504617:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788726154.504632:0:14331:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91a1032719b8) 00000020:00000080:3.0:1788726154.504661:0:14331:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788726154.504667:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788726154.504804:0:14331:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788726154.504810:0:14331:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788726154.504817:0:14331:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbde9110e47c213e 00010000:00080000:3.0:1788726154.504848:0:14331:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a105797000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788726154.505071:0:14331:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788726154.505943:0:14331:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788726154.505995:0:14331:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788726154.509911:0:14331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788726154.509987:0:14331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788726154.510060:0:14331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788726154.511290:0:14335:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788726154.511298:0:14335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788726154.514333:0:14331:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788726154.514358:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788726154.514399:0:14331:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788726154.514533:0:14331:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbde9110e47c2145 00000100:00080000:3.0:1788726154.514545:0:14331:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788726154.514551:0:14331:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91a105797000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:3.0:1788726154.514586:0:14331:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a1111d8700 x1875614935113472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788726154.514666:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935113472:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788726154.514737:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875614935113472 offset 0 length 520: 4 00000100:00080000:3.0:1788726154.515355:0:14331:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788726154.515436:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788726154.515443:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726154.515445:0:14331:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788726154.515449:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788726154.515452:0:14331:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788726154.515453:0:14331:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788726154.515455:0:14331:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788726154.515456:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788726154.515459:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726154.515460:0:14331:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788726154.515463:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788726154.515467:0:14331:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788726154.515471:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726154.515472:0:14331:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788726154.515475:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788726154.515479:0:14331:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.142@tcp to nid 0x20000c0a8c98e (192.168.201.142@tcp) 00000020:01000000:3.0:1788726154.515500:0:14331:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788726154.515503:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788726154.515516:0:14331:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91a103270000) 00000020:00000080:3.0:1788726154.515532:0:14331:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788726154.515537:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788726154.515600:0:14331:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788726154.515606:0:14331:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788726154.515621:0:14331:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbde9110e47c2153 00010000:00080000:3.0:1788726154.515687:0:14331:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a105788800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:3.0:1788726154.515973:0:14331:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788726154.516169:0:14331:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788726154.516191:0:14331:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788726154.516881:0:14331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788726154.516959:0:14331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788726154.517037:0:14331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788726154.517814:0:14337:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788726154.517820:0:14337:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788726154.518631:0:14331:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788726154.518642:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788726154.518684:0:14331:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788726154.518705:0:14331:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbde9110e47c215a 00000100:00080000:2.0:1788726154.518716:0:14331:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788726154.518722:0:14331:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91a105788800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788726154.518758:0:14331:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a141dead80 x1875614935113600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788726154.518868:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935113600:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788726154.518921:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875614935113600 offset 0 length 520: 4 00000100:00080000:2.0:1788726154.519749:0:14331:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788726154.519858:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726154.519865:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726154.519867:0:14331:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788726154.519870:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788726154.519874:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726154.519875:0:14331:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788726154.519878:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788726154.519880:0:14331:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788726154.519882:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726154.519884:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726154.519894:0:14331:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788726154.519897:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788726154.519900:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726154.519901:0:14331:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788726154.519905:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788726154.519942:0:14331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14331:1875614935113728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788726154.520001:0:14331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726154.520125:0:14331:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12ad72480 going to sleep for 11 seconds 00000100:00100000:0.0:1788726154.520388:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935113728 00000100:00100000:0.0:1788726154.520396:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935113728 00000100:00100000:0.0:1788726154.520469:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788726154.520478:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+9:14331:x1875614935113728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788726154.520776:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+9:14331:x1875614935113728:12345-0@lo:502:llog_process_th.0 Request processed in 298us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726154.520784:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788726154.520871:0:14331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14331:1875614935113728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788726154.520899:0:14331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726154.520905:0:14331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726154.520906:0:14331:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788726154.520910:0:14331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788726154.521089:0:14295:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788726154.521111:0:14295:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788726154.521160:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a1398eae00/0xcbde9110e47c20e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c20ea expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.521171:0:14295:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a1398eae00/0xcbde9110e47c20e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c20ea expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726154.521178:0:14295:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91a13ad4c800 from 1 10000000:01000000:3.0:1788726154.521181:0:14295:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788726154.521208:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a13a914600/0xcbde9110e47c2161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.521246:0:14295:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a13a914600/0xcbde9110e47c2161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.521255:0:14295:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a13a914600/0xcbde9110e47c2161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726154.521271:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935113856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788726154.521304:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726154.521335:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a141e0b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788726154.521568:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935113856 00000100:00100000:1.0:1788726154.521575:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935113856 00000100:00100000:1.0:1788726154.521613:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788726154.521621:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+9:14295:x1875614935113856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788726154.521632:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726154.521654:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a108921800/0xcbde9110e47c2168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c2161 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726154.521688:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a108921800/0xcbde9110e47c2168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c2161 expref: 10 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726154.521699:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a108921800/0xcbde9110e47c2168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c2161 expref: 10 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726154.521707:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921800, rc 0) 00000100:00100000:1.0:1788726154.521748:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+10:14295:x1875614935113856:12345-0@lo:101:mount.lustre.0 Request processed in 128us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726154.521756:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788726154.521844:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935113856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726154.521856:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a13a914600/0xcbde9110e47c2161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2168 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.521864:0:14295:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a13a914600/0xcbde9110e47c2161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c2168 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726154.522417:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935113984:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788726154.522458:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726154.522489:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12ad72480 going to sleep for 11 seconds 00000100:00100000:1.0:1788726154.522594:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935113984 00000100:00100000:1.0:1788726154.522600:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935113984 00000100:00100000:1.0:1788726154.522641:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788726154.522657:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+10:14295:x1875614935113984:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788726154.522673:0:14305:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788726154.522679:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788726154.522838:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+10:14295:x1875614935113984:12345-0@lo:256:mount.lustre.0 Request processed in 190us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726154.522846:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788726154.523007:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935113984:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788726154.523949:0:14295:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788726154.524012:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a13a914600/0xcbde9110e47c2161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2168 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.524022:0:14295:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a13a914600/0xcbde9110e47c2161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2168 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726154.524029:0:14295:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a13ad4c800 from 1 10000000:01000000:3.0:1788726154.524032:0:14295:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788726154.524063:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a13a914a00/0xcbde9110e47c216f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.524070:0:14295:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a13a914a00/0xcbde9110e47c216f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.524080:0:14295:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a13a914a00/0xcbde9110e47c216f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726154.524097:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935114112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788726154.524140:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726154.524177:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a141e0bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788726154.524299:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935114112 00000100:00100000:2.0:1788726154.524306:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935114112 00000100:00100000:2.0:1788726154.524343:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788726154.524351:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+10:14295:x1875614935114112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726154.524363:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726154.524384:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a1398eb000/0xcbde9110e47c2176 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c216f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.524403:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398eb000/0xcbde9110e47c2176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c216f expref: 11 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.524414:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a1398eb000/0xcbde9110e47c2176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c216f expref: 11 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.524422:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eb000, rc 0) 00000100:00100000:2.0:1788726154.524454:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+11:14295:x1875614935114112:12345-0@lo:101:mount.lustre.0 Request processed in 103us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726154.524460:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788726154.524704:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935114112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788726154.524716:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a13a914a00/0xcbde9110e47c216f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2176 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.524724:0:14295:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a13a914a00/0xcbde9110e47c216f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c2176 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726154.524778:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935114240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726154.524812:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726154.524842:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a141e0bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788726154.524890:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935114240 00000100:00100000:2.0:1788726154.524895:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935114240 00000100:00100000:2.0:1788726154.524925:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788726154.524932:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+11:14295:x1875614935114240:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726154.527577:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+11:14295:x1875614935114240:12345-0@lo:501:mount.lustre.0 Request processed in 2636us (2754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726154.527590:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788726154.527717:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935114240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726154.527766:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935114368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788726154.527819:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726154.527856:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a141e0bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788726154.527911:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935114368 00000100:00100000:1.0:1788726154.527919:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935114368 00000100:00100000:1.0:1788726154.527965:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788726154.527974:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+11:14295:x1875614935114368:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788726154.528134:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+11:14295:x1875614935114368:12345-0@lo:503:mount.lustre.0 Request processed in 160us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726154.528141:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788726154.529874:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935114368:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788726154.530479:0:14339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141deaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14339:1875614935114496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788726154.530548:0:14339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726154.530589:0:14339:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12ad72600 going to sleep for 11 seconds 00000100:00100000:1.0:1788726154.530630:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935114496 00000100:00100000:1.0:1788726154.530637:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935114496 00000100:00100000:1.0:1788726154.530699:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788726154.530708:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+11:14339:x1875614935114496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788726154.530968:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+11:14339:x1875614935114496:12345-0@lo:502:llog_process_th.0 Request processed in 260us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726154.530977:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788726154.531273:0:14339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141deaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14339:1875614935114496:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788726154.531301:0:14339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788726154.531312:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726154.531320:0:14339:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788726154.531328:0:14339:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a13ad4c800 00000020:00000080:2.0:1788726154.531330:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788726154.531338:0:14339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726154.531340:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726154.531341:0:14339:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788726154.531344:0:14339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788726154.531347:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726154.531348:0:14339:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788726154.531351:0:14339:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a13ad4c800 00000020:00000080:2.0:1788726154.531353:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788726154.531406:0:14339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726154.531410:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726154.531411:0:14339:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788726154.531414:0:14339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788726154.531417:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726154.531419:0:14339:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788726154.531422:0:14339:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91a13ad4c800 00000020:00000080:2.0:1788726154.531424:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788726154.531461:0:14339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141deaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14339:1875614935114624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788726154.531500:0:14339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726154.534877:0:14339:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a11044b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726154.544312:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935114624 00000100:00100000:3.0:1788726154.544337:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935114624 00000100:00100000:3.0:1788726154.544401:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788726154.544411:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+11:14339:x1875614935114624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788726154.544684:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+11:14339:x1875614935114624:12345-0@lo:502:llog_process_th.0 Request processed in 274us (13182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726154.544692:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788726154.548741:0:14339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141deaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14339:1875614935114624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788726154.548791:0:14339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726154.548801:0:14339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726154.548804:0:14339:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788726154.548809:0:14339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788726154.554923:0:14295:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788726154.554954:0:14295:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788726154.554978:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a13a914a00/0xcbde9110e47c216f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2176 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.554993:0:14295:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a13a914a00/0xcbde9110e47c216f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2176 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726154.555041:0:14295:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788726154.555044:0:14295:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91a13ad4c800 10000000:01000000:3.0:1788726154.555047:0:14295:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91a13ad4c800 10000000:01000000:3.0:1788726154.555050:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788726154.555056:0:14295:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91a13ad4c800 from 1 10000000:01000000:3.0:1788726154.555058:0:14295:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788726154.555100:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a13a914400/0xcbde9110e47c217d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.555108:0:14295:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a13a914400/0xcbde9110e47c217d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.555119:0:14295:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a13a914400/0xcbde9110e47c217d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726154.555143:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935114752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788726154.555212:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726154.555278:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a141e0bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726154.557930:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935114752 00000100:00100000:0.0:1788726154.557947:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935114752 00000100:00100000:0.0:1788726154.558010:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788726154.558020:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+11:14295:x1875614935114752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726154.558039:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726154.558058:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e725a00/0xcbde9110e47c2184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c217d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.558111:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e725a00/0xcbde9110e47c2184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c217d expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.558123:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e725a00/0xcbde9110e47c2184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c217d expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.558133:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725a00, rc 0) 00000100:00100000:0.0:1788726154.559038:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14295:x1875614935114752:12345-0@lo:101:mount.lustre.0 Request processed in 1014us (3820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726154.559048:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788726154.568039:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935114752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726154.568068:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a13a914400/0xcbde9110e47c217d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2184 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.568092:0:14295:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a13a914400/0xcbde9110e47c217d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c2184 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726154.568319:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935114880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726154.568379:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726154.568415:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935114880 00000100:00100000:2.0:1788726154.568420:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935114880 00000100:00100000:2.0:1788726154.568465:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788726154.568474:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14295:x1875614935114880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726154.568843:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14295:x1875614935114880:12345-0@lo:501:mount.lustre.0 Request processed in 368us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726154.568851:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788726154.568889:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a136b12480 going to sleep for 11 seconds 00000100:00100000:2.0:1788726154.568902:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935114880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726154.568928:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935115008:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788726154.568963:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726154.568979:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a136b12480 going to sleep for 11 seconds 00000100:00100000:1.0:1788726154.569348:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935115008 00000100:00100000:1.0:1788726154.569354:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935115008 00000100:00100000:1.0:1788726154.569392:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788726154.569399:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14295:x1875614935115008:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788726154.569545:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14295:x1875614935115008:12345-0@lo:503:mount.lustre.0 Request processed in 146us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726154.569551:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788726154.569622:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935115008:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788726154.570121:0:14345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14345:1875614935115136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788726154.570167:0:14345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726154.570200:0:14345:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1070e59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726154.570273:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935115136 00000100:00100000:2.0:1788726154.570278:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935115136 00000100:00100000:2.0:1788726154.570304:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788726154.570311:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14345:x1875614935115136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788726154.570501:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14345:x1875614935115136:12345-0@lo:502:llog_process_th.0 Request processed in 189us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726154.570516:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788726154.570588:0:14345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14345:1875614935115136:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788726154.570641:0:14345:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788726154.570668:0:14345:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff91a1111d0000) 00000020:00000080:1.0:1788726154.570688:0:14345:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788726154.570756:0:14345:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a13ad4c800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788726154.570760:0:14345:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a13ad4c800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788726154.570763:0:14345:0:(obd_mount.c:721:lustre_put_lsi()) put ffff91a13ad4c800 4 00010000:00080000:1.0:1788726154.570793:0:14345:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a139f06800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.142@tcp at head 00010000:00010000:1.0:1788726154.573209:0:14345:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788726154.574073:0:14345:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788726154.574117:0:14345:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788726154.574128:0:14345:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcbde9110e47c2192 00000100:00080000:1.0:1788726154.574139:0:14345:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788726154.574144:0:14345:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91a139f06800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788726154.574178:0:14345:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a13ab49c00 x1875614935115264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788726154.574252:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875614935115264:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788726154.574319:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726154.574428:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935115264 00000100:00100000:0.0:1788726154.574436:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935115264 00000100:00100000:0.0:1788726154.574465:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788726154.574473:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875614935115264:12345-0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788726154.574550:0:14345:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788726154.580493:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875614935115264:12345-0@lo:38:llog_process_th.0 Request processed in 6010us (6164us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788726154.580508:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788726154.583340:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788726154.583355:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a139f06800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788726154.583362:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788726154.583367:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875614935115264:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788726154.585131:0:14345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14345:1875614935115392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788726154.585247:0:14345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726154.585287:0:14345:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1070e5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788726154.585454:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935115392 00000100:00100000:2.0:1788726154.585462:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935115392 00000100:00100000:2.0:1788726154.585514:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788726154.585523:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14345:x1875614935115392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788726154.585757:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14345:x1875614935115392:12345-0@lo:502:llog_process_th.0 Request processed in 234us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726154.585764:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788726154.585922:0:14345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14345:1875614935115392:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788726154.585947:0:14345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788726154.586090:0:14295:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788726154.586109:0:14295:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788726154.586132:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a13a914400/0xcbde9110e47c217d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2184 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.586155:0:14295:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a13a914400/0xcbde9110e47c217d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2184 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788726154.586202:0:14295:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788726154.586205:0:14295:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788726154.586206:0:14295:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788726154.586207:0:14295:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788726154.586208:0:14295:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788726154.586209:0:14295:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788726154.586210:0:14295:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788726154.586212:0:14295:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788726154.586237:0:14295:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788726154.586238:0:14295:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788726154.586242:0:14295:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788726154.586244:0:14295:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788726154.586246:0:14295:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788726154.586247:0:14295:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788726154.586248:0:14295:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788726154.586254:0:14295:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788726154.586255:0:14295:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788726154.586255:0:14295:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788726154.586257:0:14295:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788726154.586257:0:14295:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788726154.586258:0:14295:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788726154.586274:0:14295:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788726154.586286:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935115520:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788726154.586319:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726154.586393:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12ad72180 going to sleep for 11 seconds 00000100:00100000:3.0:1788726154.586616:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935115520 00000100:00100000:3.0:1788726154.586622:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935115520 00000100:00100000:3.0:1788726154.586689:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788726154.586698:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14295:x1875614935115520:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788726154.586720:0:14308:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788726154.586734:0:14308:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788726154.639808:0:14308:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788726154.639829:0:14308:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788726154.639912:0:14329:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788726154.639917:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788726154.639940:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a1398eba00/0xcbde9110e47c2199 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.639958:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a108921800/0xcbde9110e47c2168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c2161 expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.639968:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a1398eba00/0xcbde9110e47c2199 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.640009:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a108921800/0xcbde9110e47c2168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c2161 expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726154.640024:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a108921800/0xcbde9110e47c2168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c2161 expref: 12 pid: 14307 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726154.640039:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141debb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14329:1875614935115648:0@lo:104: 00000100:00100000:2.0:1788726154.640115:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726154.640175:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10408a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788726154.640540:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935115648 00000100:00100000:0.0:1788726154.640549:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935115648 00000100:00100000:0.0:1788726154.640590:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788726154.640598:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141dea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+3:14329:x1875614935115648:12345-0@lo:104: 00010000:00010000:0.0:1788726154.640611:0:14296:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a13a914600/0xcbde9110e47c2161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c2168 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.640685:0:14296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788726154.640691:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141dea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+3:14329:x1875614935115648:12345-0@lo:104: Request processed in 94us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726154.640705:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788726154.640724:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726154.640729:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a13a914600/0xcbde9110e47c2161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c2168 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.640736:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914600 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788726154.640739:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a13a914600/0xcbde9110e47c2161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c2168 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.640747:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a13a914600/0xcbde9110e47c2161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c2168 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788726154.640754:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a13a914600/0xcbde9110e47c2161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c2168 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726154.640759:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788726154.640788:0:14302:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a13a914600/0xcbde9110e47c2161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c2168 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.640795:0:14302:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788726154.640814:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a13a914600/0xcbde9110e47c2161 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c2168 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.640822:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a13a914600/0xcbde9110e47c2161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c2168 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.640840:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726154.640842:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726154.640844:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726154.640920:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141debb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14329:1875614935115648:0@lo:104: 00010000:00010000:3.0:1788726154.640941:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a1398eba00/0xcbde9110e47c2199 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726154.641103:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788726154.641124:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935115776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788726154.641169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726154.641755:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935115776 00000100:00100000:0.0:1788726154.641767:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935115776 00010000:00010000:0.0:1788726154.641791:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a108921800/0xcbde9110e47c2168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c2161 expref: 13 pid: 14307 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726154.641817:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788726154.641825:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141deb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+13:3306:x1875614935115776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726154.641837:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726154.641843:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a108921800/0xcbde9110e47c2168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c2161 expref: 13 pid: 14307 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.641853:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a108921800/0xcbde9110e47c2168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c2161 expref: 13 pid: 14307 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.642030:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a108921800/0xcbde9110e47c2168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c2161 expref: 13 pid: 14307 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.642044:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a1398eba00/0xcbde9110e47c2199 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.642052:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398eba00/0xcbde9110e47c2199 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788726154.642065:0:14298:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002148278s 00010000:00010000:0.0:1788726154.642069:0:14298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a1398eba00/0xcbde9110e47c2199 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.642075:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a1398eba00/0xcbde9110e47c2199 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.642081:0:14298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a1398eba00/0xcbde9110e47c2199 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.642096:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a1398eba00/0xcbde9110e47c2199 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.642101:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eba00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:0.0:1788726154.642105:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a1398eba00/0xcbde9110e47c2199 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.642113:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a1398eba00/0xcbde9110e47c2199 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.642131:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a1398eba00/0xcbde9110e47c2199 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726154.642142:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726154.642188:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141deb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:3306:x1875614935115776:12345-0@lo:103:ldlm_bl.0 Request processed in 364us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726154.642195:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788726154.642279:0:14329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a1398eba00/0xcbde9110e47c2199 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.642288:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a1398eba00/0xcbde9110e47c2199 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726154.642294:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a1398eba00/0xcbde9110e47c2199 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726154.643589:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935115776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788726154.659291:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+11:14295:x1875614935115520:12345-0@lo:253:mount.lustre.0 Request processed in 72585us (72961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726154.659307:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788726154.659541:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14295:1875614935115520:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788726154.659558:0:14295:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788726154.659561:0:14295:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788726154.659563:0:14295:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788726154.659564:0:14295:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788726154.659566:0:14295:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788726154.659567:0:14295:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788726154.659568:0:14295:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788726154.659570:0:14295:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788726154.659572:0:14295:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788726154.659574:0:14295:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788726154.659576:0:14295:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788726154.659591:0:14295:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788726154.665369:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788726154.665529:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788726154.666294:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788726154.666459:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788726154.666807:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788726154.667085:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788726154.668502:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788726154.668683:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788726154.669130:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788726154.669559:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788726154.671978:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788726154.672152:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788726154.705123:0:14295:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788726154.705621:0:14295:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788726154.705837:0:14350:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788726154.705841:0:14350:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1788726154.706254:0:14351:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788726154.706344:0:14351:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788726154.713266:0:14295:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788726154.713398:0:14295:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788726154.713934:0:14295:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788726154.713941:0:14295:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788726154.714071:0:14295:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788726154.715060:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788726154.715140:0:14351:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788726154.715145:0:14351:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1788726154.718126:0:14295:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788726154.718771:0:14295:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788726154.718802:0:14295:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788726154.720075:0:14295:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788726154.731471:0:14295:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788726154.758813:0:14295:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788726154.758862:0:14295:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb86a81df3988 00100000:10000000:2.0:1788726154.758871:0:14295:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788726154.759724:0:14295:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788726154.759744:0:14295:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788726154.759762:0:14295:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788726154.759790:0:14295:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788726155.221595:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788726155.605875:0:14344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788726155.797491:0:14310:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788726155.797498:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91a13ad4c800 from 6 10000000:01000000:2.0:1788726155.797523:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788726155.797573:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a1398ea400/0xcbde9110e47c21a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726155.797586:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a1398ea400/0xcbde9110e47c21a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726155.797613:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a1398ea400/0xcbde9110e47c21a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726155.797649:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935115904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788726155.797720:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726155.797762:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10679c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788726155.797871:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935115904 00000100:00100000:1.0:1788726155.797879:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935115904 00000100:00100000:1.0:1788726155.797943:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788726155.797952:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+11:14310:x1875614935115904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788726155.797964:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726155.797979:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a108920200/0xcbde9110e47c21a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c21a0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726155.798000:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a108920200/0xcbde9110e47c21a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c21a0 expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726155.798010:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a108920200/0xcbde9110e47c21a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c21a0 expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726155.798019:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920200, rc 0) 00000100:00100000:1.0:1788726155.798061:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14310:x1875614935115904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726155.798068:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788726155.798213:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935115904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726155.798252:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a1398ea400/0xcbde9110e47c21a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c21a7 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726155.798260:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a1398ea400/0xcbde9110e47c21a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c21a7 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726155.798304:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935116032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788726155.798335:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726155.798353:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10679c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788726155.798512:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935116032 00000100:00100000:1.0:1788726155.798517:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935116032 00000100:00100000:1.0:1788726155.798546:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788726155.798553:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14310:x1875614935116032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788726155.798566:0:14308:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788726155.798581:0:14308:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788726155.798584:0:14308:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788726155.798665:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14310:x1875614935116032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726155.798672:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788726155.798735:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935116032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788726155.798779:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788726155.798786:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a1398ea400/0xcbde9110e47c21a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c21a7 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726155.798793:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a1398ea400/0xcbde9110e47c21a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c21a7 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726156.246421:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788726156.630771:0:14344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788726157.269940:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726158.295014:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788726158.361345:0:14593:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788726159.320316:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788726160.086247:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788726160.086255:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788726160.086258:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788726160.086261:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788726160.086264:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788726160.086268:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788726160.086271:0:37:0:(import.c:65:import_set_state_nolock()) ffff91a139f06800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788726160.086283:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91a139f06800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:2.0:1788726160.086306:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a141de9500 x1875614935116288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788726160.086355:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875614935116288:0@lo:38:kworker.0 00000100:00100000:2.0:1788726160.086436:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726160.086610:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3304:1875614935116160:0@lo:400:kworker.0 00000100:00100000:0.0:1788726160.088316:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935116288 00000100:00100000:0.0:1788726160.088330:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935116288 00000100:00100000:0.0:1788726160.088386:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788726160.088395:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875614935116288:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788726160.088424:0:14315:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:0.0:1788726160.088480:0:14315:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcbde9110e47c21ae 00000100:00100000:1.0:1788726160.088738:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726160.088947:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935116160 00000100:00100000:2.0:1788726160.088952:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935116160 00000100:00100000:2.0:1788726160.088986:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788726160.088993:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:3304:x1875614935116160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726160.089043:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:3304:x1875614935116160:12345-0@lo:400:kworker.0 Request processed in 52us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726160.089050:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788726160.089702:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3304:1875614935116160:0@lo:400:kworker.0 00000004:00100000:0.0:1788726160.092100:0:14315:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788726160.092295:0:14315:0:(import.c:65:import_set_state_nolock()) ffff91a141d06800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788726160.092390:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875614935116288:12345-0@lo:38:kworker.0 Request processed in 3994us (5952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726160.092402:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788726160.092984:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a141de9500 x1875614935116288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788726170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788726160.093002:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788726160.093012:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788726160.093016:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788726160.093018:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a139f06800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788726160.093024:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875614935116288:0@lo:38:kworker.0 00010000:00010000:0.0:1788726160.344138:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788726161.111111:0:14744:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff951fe660 20000000:00000080:1.0:1788726161.111131:0:14744:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91a13f078400 uarg=0000000000000000 20000000:01000000:1.0:1788726161.111169:0:14744:0:(mgs_llog.c:6195:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788726161.111177:0:14744:0:(mgs_llog.c:4650:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788726161.111181:0:14744:0:(mgs_llog.c:1382:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788726161.113016:0:14745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788726161.113179:0:14744:0:(mgs_llog.c:1453:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788726161.120443:0:14744:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788726161.120588:0:14744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a13a915e00/0xcbde9110e47c21b5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726161.120609:0:14744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a1398eb000/0xcbde9110e47c2176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c216f expref: 11 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726161.120618:0:14744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a13a915e00/0xcbde9110e47c21b5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726161.120680:0:14744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a1398eb000/0xcbde9110e47c2176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c216f expref: 11 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726161.120697:0:14744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a1398eb000/0xcbde9110e47c2176 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c216f expref: 11 pid: 14308 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726161.120712:0:14744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14744:1875614935116416:0@lo:104: 00000100:00100000:3.0:1788726161.120843:0:14744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726161.120928:0:14744:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1129f9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788726161.120993:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935116416 00000100:00100000:2.0:1788726161.121001:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935116416 00000100:00100000:2.0:1788726161.121085:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788726161.121095:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+3:14744:x1875614935116416:12345-0@lo:104: 00010000:00010000:2.0:1788726161.121114:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a13a914a00/0xcbde9110e47c216f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c2176 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726161.121182:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788726161.121189:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+3:14744:x1875614935116416:12345-0@lo:104: Request processed in 96us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726161.121196:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788726161.121312:0:14744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14744:1875614935116416:0@lo:104: 00010000:00010000:3.0:1788726161.121330:0:14744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a13a915e00/0xcbde9110e47c21b5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121403:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726161.121411:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a13a914a00/0xcbde9110e47c216f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c2176 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121419:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914a00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:1.0:1788726161.121423:0:14301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a13a914a00/0xcbde9110e47c216f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c2176 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121432:0:14301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a13a914a00/0xcbde9110e47c216f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c2176 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788726161.121439:0:14301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a13a914a00/0xcbde9110e47c216f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c2176 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726161.121444:0:14301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788726161.121473:0:14301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a13a914a00/0xcbde9110e47c216f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c2176 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121480:0:14301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788726161.121500:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a13a914a00/0xcbde9110e47c216f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c2176 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121507:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a13a914a00/0xcbde9110e47c216f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c2176 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121527:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726161.121529:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726161.121550:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726161.121564:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3305:1875614935116544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788726161.121595:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726161.121640:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935116544 00000100:00100000:1.0:1788726161.121645:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935116544 00010000:00010000:1.0:1788726161.121664:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a1398eb000/0xcbde9110e47c2176 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c216f expref: 12 pid: 14308 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726161.121687:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788726161.121694:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:3305:x1875614935116544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788726161.121705:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726161.121709:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a1398eb000/0xcbde9110e47c2176 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c216f expref: 12 pid: 14308 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121720:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a1398eb000/0xcbde9110e47c2176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c216f expref: 12 pid: 14308 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121733:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a1398eb000/0xcbde9110e47c2176 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c216f expref: 12 pid: 14308 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121758:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a13a915e00/0xcbde9110e47c21b5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121767:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a13a915e00/0xcbde9110e47c21b5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121780:0:14298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a13a915e00/0xcbde9110e47c21b5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121788:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a13a915e00/0xcbde9110e47c21b5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121804:0:14298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a13a915e00/0xcbde9110e47c21b5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121810:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a13a915e00/0xcbde9110e47c21b5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121816:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915e00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726161.121820:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a13a915e00/0xcbde9110e47c21b5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121828:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a13a915e00/0xcbde9110e47c21b5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121840:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a13a915e00/0xcbde9110e47c21b5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726161.121850:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726161.121877:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+11:3305:x1875614935116544:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726161.121884:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788726161.121913:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3305:1875614935116544:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788726161.122052:0:14744:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a13a915e00/0xcbde9110e47c21b5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726161.122060:0:14744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a13a915e00/0xcbde9110e47c21b5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726161.122066:0:14744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a13a915e00/0xcbde9110e47c21b5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726161.367208:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726162.390247:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788726162.901292:0:14310:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788726162.901301:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a13ad4c800 from 10 10000000:01000000:3.0:1788726162.901306:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788726162.901351:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a13a915e00/0xcbde9110e47c21bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726162.901363:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a13a915e00/0xcbde9110e47c21bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726162.901388:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a13a915e00/0xcbde9110e47c21bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726162.901413:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935116672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788726162.901518:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726162.901572:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1068f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788726162.901658:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935116672 00000100:00100000:2.0:1788726162.901666:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935116672 00000100:00100000:2.0:1788726162.901719:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788726162.901736:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+11:14310:x1875614935116672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726162.901750:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726162.901929:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a1398eb800/0xcbde9110e47c21c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c21bc expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726162.901955:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398eb800/0xcbde9110e47c21c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c21bc expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726162.901967:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a1398eb800/0xcbde9110e47c21c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c21bc expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726162.901976:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eb800, rc 0) 00000100:00100000:2.0:1788726162.902026:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14310:x1875614935116672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 291us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726162.902034:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788726162.902120:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935116672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726162.902135:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a13a915e00/0xcbde9110e47c21bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c21c3 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726162.902143:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a13a915e00/0xcbde9110e47c21bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c21c3 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726162.902199:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935116800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726162.902249:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726162.902270:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1068f8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788726162.902909:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935116800 00000100:00100000:0.0:1788726162.902916:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935116800 00000100:00100000:0.0:1788726162.903001:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788726162.903010:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14310:x1875614935116800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788726162.904384:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14310:x1875614935116800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1370us (2129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726162.904396:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788726162.904894:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935116800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726162.904945:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935116928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726162.904992:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726162.905034:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1068f8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788726162.905092:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935116928 00000100:00100000:0.0:1788726162.905099:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935116928 00000100:00100000:0.0:1788726162.905145:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788726162.905153:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14310:x1875614935116928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788726162.905824:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14310:x1875614935116928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 669us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726162.905832:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788726162.905869:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935116928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788726162.907206:0:14817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788726162.907474:0:14310:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788726162.907492:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788726162.907502:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a13a915e00/0xcbde9110e47c21bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c21c3 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726162.907535:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a13a915e00/0xcbde9110e47c21bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c21c3 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726163.418512:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726164.181436:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726154/real 1788726154] req@ffff91a141dead80 x1875614935113600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726164 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726164.181480:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91a141dead80 x1875614935113600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726164 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726164.181503:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726154/real 1788726154] req@ffff91a1111d8700 x1875614935113472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726164 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726164.181515:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91a1111d8700 x1875614935113472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726164 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788726164.181533:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a105788800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788726164.181548:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788726164.181552:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935113600:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788726164.181557:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a105797000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788726164.181562:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788726164.181565:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935113472:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788726164.181683:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726164.181688:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788726164.181691:0:36:0:(import.c:65:import_set_state_nolock()) ffff91a105797000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788726164.181696:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 449 00000100:00080000:1.0:1788726164.181701:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788726164.181707:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91a105797000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788726164.181732:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a13ab48000 x1875614935117184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788726164.181747:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726164.181750:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788726164.181752:0:36:0:(import.c:65:import_set_state_nolock()) ffff91a105788800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788726164.181755:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 449 00000100:00080000:1.0:1788726164.181758:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788726164.181761:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91a105788800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788726164.181771:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a13ab4a680 x1875614935117312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788726164.181801:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935117184:0@lo:8:kworker.0 00000400:00000100:1.0:1788726164.181850:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875614935117184 offset 0 length 520: 4 00000100:00100000:1.0:1788726164.181894:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935117312:0@lo:8:kworker.0 00000100:00100000:0.0:1788726164.181994:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935117440:0@lo:400:kworker.0 00000100:00100000:0.0:1788726164.182037:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726164.182061:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788726164.182066:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3307:1875614935117056:0@lo:400:kworker.0 00000100:00100000:0.0:1788726164.182104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726164.182142:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935117440 00000100:00100000:0.0:1788726164.182150:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935117440 00000100:00100000:0.0:1788726164.182193:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788726164.182203:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935117440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726164.182276:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935117440:12345-0@lo:400:kworker.0 Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726164.182283:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788726164.182323:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a13ab4a300 x1875614935117440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726164.182346:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935117440:0@lo:400:kworker.0 00000400:00000100:1.0:1788726164.182425:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875614935117312 offset 0 length 520: 4 00000100:00100000:3.0:1788726164.182675:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935117056 00000100:00100000:3.0:1788726164.182680:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935117056 00000100:00100000:3.0:1788726164.182717:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788726164.182725:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:3307:x1875614935117056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726164.182777:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:3307:x1875614935117056:12345-0@lo:400:kworker.0 Request processed in 53us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726164.182785:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788726164.182891:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3307:1875614935117056:0@lo:400:kworker.0 00010000:00010000:1.0:1788726164.439908:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726165.461335:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788726165.705937:0:14993:0:(obd_mount.c:934:lmd_print()) mount data: 00000020:01000004:1.0:1788726165.705941:0:14993:0:(obd_mount.c:937:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788726165.706180:0:14993:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91a139f03000 00000020:01000004:1.0:1788726165.706196:0:14993:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788726165.706209:0:14993:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788726165.706247:0:14993:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91a1111d4d28) 00000020:00000080:1.0:1788726165.706265:0:14993:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788726165.734690:0:14993:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788726165.735748:0:14993:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788726165.736756:0:14993:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788726165.737040:0:14993:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788726165.737429:0:14993:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788726165.737797:0:14993:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:0.0:1788726165.738052:0:14993:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 529: rc = 0 00100000:10000000:0.0:1788726165.738206:0:14993:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 529: rc = 0 00100000:10000000:0.0:1788726165.742613:0:14993:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 773: rc = 0 00100000:10000000:0.0:1788726165.745300:0:14993:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 773: rc = 0 00100000:10000000:0.0:1788726165.745710:0:14993:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:0.0:1788726165.745947:0:14993:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 773: rc = 0 00100000:10000000:0.0:1788726165.746186:0:14993:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 773: rc = 0 00100000:10000000:0.0:1788726165.746454:0:14993:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00000020:00000080:0.0:1788726165.746997:0:14993:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788726165.747007:0:14993:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788726165.747017:0:14993:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcbde9110e47c21d1 00000020:01000004:0.0:1788726165.747024:0:14993:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788726165.747044:0:14993:0:(obd_mount.c:414:lustre_start_mgc()) MGC192.168.201.142@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788726165.747047:0:14993:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788726165.747052:0:14993:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788726165.747056:0:14993:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788726165.747065:0:14993:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91a00611cd28) 00000020:00000080:0.0:1788726165.747074:0:14993:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788726165.748085:0:14993:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788726165.748260:0:14993:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788726165.748265:0:14993:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788726165.754247:0:14993:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788726165.754261:0:14993:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788726165.754627:0:14993:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788726165.754633:0:14993:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788726165.758780:0:14993:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788726165.759176:0:14993:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788726165.759183:0:14993:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788726165.759925:0:14993:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788726165.759933:0:14993:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788726165.794399:0:14993:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788726165.794714:0:14993:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788726165.794721:0:14993:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788726165.795855:0:14993:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788726165.795918:0:14993:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788726165.796908:0:14993:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788726165.796917:0:14993:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788726165.799658:0:14993:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788726165.799908:0:14993:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788726165.799915:0:14993:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788726165.800993:0:14993:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788726165.801004:0:14993:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788726165.856451:0:14993:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788726165.857960:0:14993:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788726165.857970:0:14993:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788726165.860627:0:14993:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788726165.860643:0:14993:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788726165.864661:0:14993:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788726165.864690:0:14993:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788726165.864697:0:14993:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788726165.898095:0:14993:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788726165.898151:0:14993:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.142@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788726165.898155:0:14993:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788726165.898157:0:14993:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788726165.898159:0:14993:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788726165.898160:0:14993:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788726165.898162:0:14993:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788726165.898163:0:14993:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788726165.898165:0:14993:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788726165.898167:0:14993:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788726165.898168:0:14993:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788726165.898172:0:14993:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788726165.898174:0:14993:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788726165.898176:0:14993:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788726165.898177:0:14993:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788726165.898178:0:14993:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788726165.898179:0:14993:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788726165.898181:0:14993:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788726165.898182:0:14993:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788726165.898183:0:14993:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788726165.898184:0:14993:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788726165.898754:0:14993:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788726165.898781:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935117568:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788726165.898864:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726165.898986:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10339f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788726165.902387:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935117568 00000100:00100000:0.0:1788726165.902401:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935117568 00000100:00100000:2.0:1788726165.903836:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788726165.903851:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14993:x1875614935117568:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788726165.903900:0:14307:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788726165.903903:0:14307:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788726165.903908:0:14307:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788726165.919681:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14993:x1875614935117568:12345-0@lo:253:mount.lustre.0 Request processed in 15824us (20807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726165.919696:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788726165.919820:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935117568:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788726165.919837:0:14993:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788726165.919840:0:14993:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788726165.919842:0:14993:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788726165.919844:0:14993:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788726165.919845:0:14993:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788726165.919846:0:14993:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788726165.919848:0:14993:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788726165.919849:0:14993:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788726165.919851:0:14993:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788726165.919853:0:14993:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788726165.919871:0:14993:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91a139f03000 from lustre-OST0000 10000000:01000000:1.0:1788726165.919896:0:14993:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788726165.919910:0:14993:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788726165.919917:0:14993:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91a110b48000 local copy 00010000:00010000:1.0:1788726165.919928:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c20c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c20ce expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726165.920154:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935117696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788726165.920183:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726165.920210:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111014f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788726165.920387:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935117696 00000100:00100000:0.0:1788726165.920394:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935117696 00000100:00100000:0.0:1788726165.920468:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788726165.920476:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14993:x1875614935117696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726165.920611:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14993:x1875614935117696:12345-0@lo:501:mount.lustre.0 Request processed in 135us (426us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788726165.920616:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788726165.920674:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935117696:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788726165.920685:0:14993:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788726165.920810:0:14993:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788726165.920818:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c20c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c20ce expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726165.920827:0:14993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c20c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c20ce expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726165.920845:0:14993:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91a139f03000 10000000:01000000:1.0:1788726165.920849:0:14993:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788726165.920852:0:14993:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91a110b48000 10000000:01000000:1.0:1788726165.920853:0:14993:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788726165.920856:0:14993:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff91a110b48000 from 1 10000000:01000000:1.0:1788726165.920857:0:14993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788726165.920876:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a108920e00/0xcbde9110e47c21df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726165.920881:0:14993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a108920e00/0xcbde9110e47c21df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726165.920903:0:14993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a108920e00/0xcbde9110e47c21df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726165.920917:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935117824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788726165.920944:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726165.921168:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111014f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788726165.921205:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935117824 00000100:00100000:3.0:1788726165.921231:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935117824 00000100:00100000:3.0:1788726165.921254:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788726165.921260:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+12:14993:x1875614935117824:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788726165.921269:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726165.921283:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a13a914c00/0xcbde9110e47c21e6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c21df expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726165.921303:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a13a914c00/0xcbde9110e47c21e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c21df expref: 13 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726165.921312:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a13a914c00/0xcbde9110e47c21e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c21df expref: 13 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726165.921321:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a13a914c00, rc 0) 00000100:00100000:3.0:1788726165.921437:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+13:14993:x1875614935117824:12345-0@lo:101:mount.lustre.0 Request processed in 176us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726165.921443:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788726165.921521:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935117824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788726165.921534:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a108920e00/0xcbde9110e47c21df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c21e6 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726165.921543:0:14993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a108920e00/0xcbde9110e47c21df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c21e6 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726165.921556:0:14993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788726165.921566:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a108920e00/0xcbde9110e47c21df lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c21e6 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726165.921574:0:14993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a108920e00/0xcbde9110e47c21df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c21e6 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726165.921580:0:14993:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788726165.921584:0:14993:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788726165.921588:0:14993:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788726165.921591:0:14993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788726165.921606:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a108921800/0xcbde9110e47c21ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726165.921614:0:14993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a108921800/0xcbde9110e47c21ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726165.921627:0:14993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a108921800/0xcbde9110e47c21ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726165.921636:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935117952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788726165.921745:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726165.921772:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111014f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788726165.921826:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935117952 00000100:00100000:2.0:1788726165.921831:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935117952 00000100:00100000:2.0:1788726165.921886:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788726165.921894:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13399dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+13:14993:x1875614935117952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726165.921902:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726165.921910:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c21f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c21ed expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726165.921925:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c21f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c21ed expref: 14 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726165.921932:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a1398ebe00/0xcbde9110e47c21f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c21ed expref: 14 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726165.921939:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ebe00, rc 0) 00000100:00100000:2.0:1788726165.921975:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13399dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+14:14993:x1875614935117952:12345-0@lo:101:mount.lustre.0 Request processed in 82us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726165.921988:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788726165.922093:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935117952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788726165.922101:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a108921800/0xcbde9110e47c21ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c21f4 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726165.922107:0:14993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a108921800/0xcbde9110e47c21ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c21f4 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788726165.922645:0:14993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788726165.923875:0:14993:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788726165.924309:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788726165.924354:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788726165.924375:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788726165.924403:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788726165.924422:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788726165.924439:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788726165.924514:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788726165.924522:0:14993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788726165.924601:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788726165.924981:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726165.925025:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111014000 going to sleep for 11 seconds 00000100:00100000:3.0:1788726165.925175:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935118080 00000100:00100000:3.0:1788726165.925181:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935118080 00000100:00100000:3.0:1788726165.925241:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788726165.925251:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+14:14993:x1875614935118080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726165.925998:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+14:14993:x1875614935118080:12345-0@lo:501:mount.lustre.0 Request processed in 746us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726165.926008:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788726165.926525:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788726165.926583:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788726165.926622:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726165.926680:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935118208 00000100:00100000:2.0:1788726165.926686:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935118208 00000100:00100000:1.0:1788726165.926834:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111014000 going to sleep for 11 seconds 00000100:00100000:2.0:1788726165.927068:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788726165.927078:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+14:14993:x1875614935118208:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788726165.927397:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+14:14993:x1875614935118208:12345-0@lo:503:mount.lustre.0 Request processed in 320us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726165.927405:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788726165.927421:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118208:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788726165.929030:0:14993:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788726165.929106:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118336:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726165.929160:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726165.929203:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111014000 going to sleep for 11 seconds 00000100:00100000:3.0:1788726165.929230:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935118336 00000100:00100000:3.0:1788726165.929237:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935118336 00000100:00100000:3.0:1788726165.929281:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788726165.929290:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+14:14993:x1875614935118336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788726165.929492:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+14:14993:x1875614935118336:12345-0@lo:502:mount.lustre.0 Request processed in 203us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726165.929499:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788726165.929586:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118336:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788726165.930028:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788726165.930074:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788726165.930109:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788726165.930154:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788726165.930177:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788726165.930195:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788726165.930319:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788726165.930353:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788726165.930372:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788726165.930398:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788726165.930417:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788726165.930440:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788726165.930490:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726165.930541:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726165.930579:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111014000 going to sleep for 11 seconds 00000100:00100000:2.0:1788726165.930785:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935118464 00000100:00100000:2.0:1788726165.930792:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935118464 00000100:00100000:2.0:1788726165.930840:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788726165.930848:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+14:14993:x1875614935118464:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726165.931343:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788726165.931407:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788726165.931426:0:14993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000100:00100000:2.0:1788726165.931906:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+14:14993:x1875614935118464:12345-0@lo:502:mount.lustre.0 Request processed in 365us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726165.931919:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:01000000:2.0:1788726165.933098:0:15007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788726165.933107:0:15007:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788726165.933114:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726165.933116:0:15007:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788726165.933122:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788726165.933139:0:15007:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff91a13b260000) 00000020:00000080:2.0:1788726165.933161:0:15007:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788726165.933168:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788726165.933348:0:15007:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a139f03000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788726165.933356:0:15007:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788726165.933362:0:15007:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcbde9110e47c2202 00010000:00010000:2.0:1788726165.938211:0:15007:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788726165.938829:0:15007:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788726165.945568:0:15007:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788726165.947868:0:15007:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788726165.947894:0:15007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788726165.947902:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726165.947905:0:15007:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788726165.947909:0:15007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788726165.947911:0:15007:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788726165.947912:0:15007:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788726165.947913:0:15007:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788726165.947914:0:15007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788726165.947916:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726165.947917:0:15007:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788726165.947918:0:15007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788726165.947920:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726165.947921:0:15007:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788726165.947922:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788726165.947931:0:15007:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788726165.947933:0:15007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788726165.947934:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726165.947935:0:15007:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788726165.947937:0:15007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788726165.947938:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726165.947939:0:15007:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788726165.947941:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788726165.947990:0:15007:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788726165.947992:0:15007:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726165.947992:0:15007:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788726165.947994:0:15007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788726165.948507:0:14993:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788726165.948541:0:14993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788726165.948565:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a108921800/0xcbde9110e47c21ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c21f4 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726165.948577:0:14993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a108921800/0xcbde9110e47c21ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c21f4 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726165.948585:0:14993:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a139f03000 from 1 10000000:01000000:1.0:1788726165.948587:0:14993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788726165.948623:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a108921000/0xcbde9110e47c2209 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726165.948631:0:14993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a108921000/0xcbde9110e47c2209 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726165.948641:0:14993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a108921000/0xcbde9110e47c2209 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726165.948959:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788726165.949109:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726165.949213:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111014000 going to sleep for 11 seconds 00000100:00100000:0.0:1788726165.949291:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935118592 00000100:00100000:0.0:1788726165.949299:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935118592 00000100:00100000:0.0:1788726165.949384:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788726165.949401:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+14:14993:x1875614935118592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726165.949416:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726165.949430:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e725200/0xcbde9110e47c2210 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c2209 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726165.949464:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e725200/0xcbde9110e47c2210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c2209 expref: 15 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726165.949485:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e725200/0xcbde9110e47c2210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c2209 expref: 15 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726165.949495:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725200, rc 0) 00000100:00100000:0.0:1788726165.949548:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+15:14993:x1875614935118592:12345-0@lo:101:mount.lustre.0 Request processed in 150us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726165.949555:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788726165.949628:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788726165.949642:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a108921000/0xcbde9110e47c2209 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2210 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726165.949651:0:14993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a108921000/0xcbde9110e47c2209 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c2210 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788726165.951197:0:14993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788726165.954335:0:14993:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788726165.954699:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788726165.954753:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788726165.954816:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788726165.954824:0:14993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788726165.954921:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726165.954988:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726165.955042:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1070e5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788726165.955385:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935118720 00000100:00100000:2.0:1788726165.955394:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935118720 00000100:00100000:2.0:1788726165.955449:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788726165.955468:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+15:14993:x1875614935118720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726165.955954:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+15:14993:x1875614935118720:12345-0@lo:501:mount.lustre.0 Request processed in 487us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726165.955964:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788726165.956603:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726165.956648:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788726165.956704:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726165.956748:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1070e5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788726165.958898:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935118848 00000100:00100000:1.0:1788726165.958912:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935118848 00000100:00100000:1.0:1788726165.958965:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788726165.958975:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+15:14993:x1875614935118848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788726165.959234:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+15:14993:x1875614935118848:12345-0@lo:503:mount.lustre.0 Request processed in 260us (2529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726165.959252:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788726165.962820:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118848:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788726165.964437:0:14993:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788726165.964548:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726165.964640:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726165.964684:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a0058810c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726165.964923:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935118976 00000100:00100000:2.0:1788726165.964929:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935118976 00000100:00100000:2.0:1788726165.964978:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788726165.964988:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+15:14993:x1875614935118976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726165.965190:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+15:14993:x1875614935118976:12345-0@lo:502:mount.lustre.0 Request processed in 202us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726165.965197:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788726165.967028:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935118976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788726165.967688:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788726165.967869:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788726165.968018:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788726165.968057:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788726165.968092:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788726165.968141:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788726165.968177:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788726165.968209:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788726165.969084:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935119104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726165.969169:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726165.969213:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a0058810c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726165.969259:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935119104 00000100:00100000:1.0:1788726165.969267:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935119104 00000100:00100000:1.0:1788726165.969312:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788726165.969321:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+15:14993:x1875614935119104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726165.969542:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+15:14993:x1875614935119104:12345-0@lo:502:mount.lustre.0 Request processed in 221us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726165.969551:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788726165.969992:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935119104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788726165.970124:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788726165.970136:0:14993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788726165.976276:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788726165.976290:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726165.976293:0:15011:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788726165.976301:0:15011:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a139f03000 00000020:00000080:2.0:1788726165.976304:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788726165.976327:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726165.976330:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726165.976332:0:15011:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788726165.976335:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788726165.976337:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726165.976338:0:15011:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788726165.976342:0:15011:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a139f03000 00000020:00000080:2.0:1788726165.976344:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788726165.976420:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726165.976424:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726165.976425:0:15011:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788726165.976441:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788726165.976445:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726165.976446:0:15011:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788726165.976450:0:15011:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91a139f03000 00000020:00000080:2.0:1788726165.976462:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788726165.976505:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726165.976508:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726165.976510:0:15011:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788726165.976513:0:15011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788726165.980884:0:14993:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788726165.980927:0:14993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788726165.980958:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a108921000/0xcbde9110e47c2209 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2210 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726165.980973:0:14993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a108921000/0xcbde9110e47c2209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2210 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726165.981021:0:14993:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788726165.981024:0:14993:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91a139f03000 10000000:01000000:3.0:1788726165.981027:0:14993:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91a139f03000 10000000:01000000:3.0:1788726165.981030:0:14993:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788726165.981036:0:14993:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91a139f03000 from 1 10000000:01000000:3.0:1788726165.981039:0:14993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788726165.981073:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a13a915600/0xcbde9110e47c2217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726165.981082:0:14993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a13a915600/0xcbde9110e47c2217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726165.981093:0:14993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a13a915600/0xcbde9110e47c2217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726165.981119:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935119232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788726165.981190:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726165.981287:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13aed0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788726165.982332:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935119232 00000100:00100000:0.0:1788726165.982345:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935119232 00000100:00100000:0.0:1788726165.982417:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788726165.982428:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+15:14993:x1875614935119232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726165.982445:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726165.982472:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c221e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c2217 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726165.982497:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c221e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c2217 expref: 16 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726165.982508:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e725e00/0xcbde9110e47c221e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c2217 expref: 16 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726165.982519:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e725e00, rc 0) 00000100:00100000:0.0:1788726165.982584:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:14993:x1875614935119232:12345-0@lo:101:mount.lustre.0 Request processed in 158us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726165.982591:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788726165.990442:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935119232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788726165.990613:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a13a915600/0xcbde9110e47c2217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c221e expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726165.990628:0:14993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a13a915600/0xcbde9110e47c2217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c221e expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788726165.992044:0:14993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788726165.993169:0:14993:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788726165.993731:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788726165.993777:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788726165.993813:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788726165.993860:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788726165.993898:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788726165.994156:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788726165.994206:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788726165.995828:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788726165.998412:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788726166.003308:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788726166.003385:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788726166.005771:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788726166.005890:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788726166.005958:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788726166.006064:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788726166.006114:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788726166.006145:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788726166.006181:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788726166.006209:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788726166.006288:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788726166.006339:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788726166.006362:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788726166.006418:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788726166.006492:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788726166.006532:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788726166.006552:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788726166.006597:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788726166.006630:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788726166.006723:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788726166.006743:0:14993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788726166.006843:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935119360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726166.006895:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726166.006936:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13aed0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788726166.006947:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935119360 00000100:00100000:2.0:1788726166.006954:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935119360 00000100:00100000:2.0:1788726166.007010:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788726166.007020:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:14993:x1875614935119360:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726166.007285:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:14993:x1875614935119360:12345-0@lo:501:mount.lustre.0 Request processed in 266us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726166.007293:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788726166.011539:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935119360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726166.011605:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935119488:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788726166.011913:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726166.011999:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13aed0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788726166.012112:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935119488 00000100:00100000:2.0:1788726166.012120:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935119488 00000100:00100000:2.0:1788726166.012209:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788726166.012290:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:14993:x1875614935119488:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788726166.012518:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:14993:x1875614935119488:12345-0@lo:503:mount.lustre.0 Request processed in 231us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726166.012528:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788726166.015574:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935119488:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788726166.016766:0:14993:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788726166.016869:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935119616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726166.017029:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726166.017076:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a005881e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788726166.017086:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935119616 00000100:00100000:3.0:1788726166.017094:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935119616 00000100:00100000:3.0:1788726166.017140:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788726166.017149:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:14993:x1875614935119616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788726166.017401:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:14993:x1875614935119616:12345-0@lo:502:mount.lustre.0 Request processed in 253us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726166.017410:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788726166.017436:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935119616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788726166.017800:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788726166.017862:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788726166.017991:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788726166.018047:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788726166.018088:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788726166.018140:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788726166.018194:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788726166.020971:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788726166.021088:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788726166.021126:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788726166.021158:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788726166.021199:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788726166.021773:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788726166.021814:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788726166.022410:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788726166.022474:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788726166.022510:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788726166.022568:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788726166.022602:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788726166.022631:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788726166.023003:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788726166.023033:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788726166.023059:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788726166.023125:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788726166.023158:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788726166.023188:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788726166.023253:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788726166.023291:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788726166.023758:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788726166.023821:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788726166.023860:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788726166.024427:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788726166.024486:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788726166.024580:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788726166.024630:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788726166.024841:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788726166.024968:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788726166.025012:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788726166.025068:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788726166.025127:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788726166.025186:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935119744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726166.025423:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726166.025482:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10fa24000 going to sleep for 11 seconds 00000100:00100000:0.0:1788726166.025553:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935119744 00000100:00100000:0.0:1788726166.025561:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935119744 00000100:00100000:0.0:1788726166.025613:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788726166.025623:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:14993:x1875614935119744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726166.026128:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:14993:x1875614935119744:12345-0@lo:502:mount.lustre.0 Request processed in 503us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726166.026138:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788726166.026165:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935119744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788726166.026277:0:14993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788726166.026492:0:14993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788726166.028576:0:15016:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788726166.028629:0:15016:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91a1111d3370) 00000020:00000080:1.0:1788726166.028655:0:15016:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788726166.028734:0:15016:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a139f03000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788726166.028738:0:15016:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a139f03000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788726166.028740:0:15016:0:(obd_mount.c:721:lustre_put_lsi()) put ffff91a139f03000 3 00010000:00080000:1.0:1788726166.028772:0:15016:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a104c7b800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.142@tcp at head 00010000:00010000:1.0:1788726166.030202:0:15016:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788726166.030407:0:15016:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788726166.030436:0:15016:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788726166.030447:0:15016:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcbde9110e47c222c 00000100:00080000:1.0:1788726166.030466:0:15016:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788726166.030472:0:15016:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91a104c7b800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788726166.030505:0:15016:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a13ab49180 x1875614935119872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788726166.030542:0:15016:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788726166.030754:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875614935119872:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788726166.030827:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726166.031626:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935119872 00000100:00100000:1.0:1788726166.031645:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935119872 00000100:00080000:0.0:1788726166.031780:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788726166.031785:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788726166.031788:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788726166.031790:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788726166.031795:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788726166.031802:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875614935119872:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788726166.031842:0:14313:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000100:00100000:0.0:1788726166.031850:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935120000:0@lo:400:kworker.0 00000020:00000080:1.0:1788726166.031876:0:14313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcbde9110e47c2233 00000100:00100000:0.0:1788726166.031885:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:1.0:1788726166.031888:0:14313:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788726166.031919:0:14313:0:(import.c:65:import_set_state_nolock()) ffff91a1398d9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788726166.031973:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875614935119872:12345-0@lo:38:llog_process_th.0 Request processed in 170us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726166.031981:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788726166.037736:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a13ab49180 x1875614935119872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788726176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726166.037752:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788726166.037765:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788726166.037776:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788726166.037783:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788726166.037786:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a104c7b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788726166.037813:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875614935119872:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788726166.040623:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935120000 00000100:00100000:1.0:1788726166.040640:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935120000 00000100:00100000:1.0:1788726166.040688:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788726166.040698:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935120000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726166.040858:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935120000:12345-0@lo:400:kworker.0 Request processed in 161us (8970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726166.040866:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788726166.044084:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91a141c4bb80 x1875614935120000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726166.044108:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935120000:0@lo:400:kworker.0 00000040:00080000:0.0:1788726166.044468:0:15016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788726166.044541:0:14993:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788726166.044566:0:14993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788726166.044591:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a13a915600/0xcbde9110e47c2217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c221e expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726166.044603:0:14993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a13a915600/0xcbde9110e47c2217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c221e expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788726166.044655:0:14993:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788726166.044657:0:14993:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788726166.044658:0:14993:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788726166.044660:0:14993:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788726166.044661:0:14993:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788726166.044662:0:14993:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788726166.044664:0:14993:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788726166.044666:0:14993:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788726166.044667:0:14993:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788726166.044670:0:14993:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788726166.044673:0:14993:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788726166.044674:0:14993:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788726166.044675:0:14993:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788726166.044676:0:14993:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788726166.044677:0:14993:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788726166.044678:0:14993:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788726166.044679:0:14993:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788726166.044680:0:14993:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788726166.044681:0:14993:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788726166.044720:0:14993:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788726166.044739:0:14993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141deb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935120128:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788726166.044824:0:14993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726166.044859:0:14993:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a107e6b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726166.045004:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935120128 00000100:00100000:1.0:1788726166.045011:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935120128 00000100:00100000:1.0:1788726166.045063:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788726166.045074:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:14993:x1875614935120128:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788726166.045114:0:14305:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788726166.045138:0:14305:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788726166.085847:0:14305:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788726166.085914:0:14305:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788726166.086025:0:14329:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788726166.086032:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788726166.086055:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c223a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726166.086074:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a108920200/0xcbde9110e47c21a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c21a0 expref: 16 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726166.086082:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c223a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726166.086124:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a108920200/0xcbde9110e47c21a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c21a0 expref: 16 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726166.086140:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a108920200/0xcbde9110e47c21a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c21a0 expref: 16 pid: 14307 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726166.086154:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141deb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14329:1875614935120256:0@lo:104: 00000100:00100000:2.0:1788726166.087069:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726166.087117:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a10e7cf900 going to sleep for 11 seconds 00000100:00100000:0.0:1788726166.087909:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935120256 00000100:00100000:0.0:1788726166.087920:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935120256 00000100:00100000:0.0:1788726166.087980:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788726166.087991:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141dead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+3:14329:x1875614935120256:12345-0@lo:104: 00010000:00010000:0.0:1788726166.088009:0:14296:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a1398ea400/0xcbde9110e47c21a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c21a7 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088105:0:14296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788726166.088112:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141dead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+3:14329:x1875614935120256:12345-0@lo:104: Request processed in 123us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726166.088119:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788726166.088164:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141deb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14329:1875614935120256:0@lo:104: 00010000:00010000:0.0:1788726166.088190:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c223a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088265:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726166.088272:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a1398ea400/0xcbde9110e47c21a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c21a7 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088280:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea400 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788726166.088284:0:14301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a1398ea400/0xcbde9110e47c21a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c21a7 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088292:0:14301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a1398ea400/0xcbde9110e47c21a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c21a7 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788726166.088298:0:14301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a1398ea400/0xcbde9110e47c21a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c21a7 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726166.088304:0:14301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788726166.088347:0:14301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a1398ea400/0xcbde9110e47c21a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c21a7 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088353:0:14301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788726166.088372:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a1398ea400/0xcbde9110e47c21a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c21a7 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088391:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a1398ea400/0xcbde9110e47c21a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c21a7 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088408:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726166.088410:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726166.088412:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726166.088427:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3305:1875614935120384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726166.088474:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726166.088521:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935120384 00000100:00100000:0.0:1788726166.088525:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935120384 00010000:00010000:0.0:1788726166.088541:0:14300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a108920200/0xcbde9110e47c21a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c21a0 expref: 17 pid: 14307 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726166.088562:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788726166.088569:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:3305:x1875614935120384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726166.088580:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726166.088587:0:14300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a108920200/0xcbde9110e47c21a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c21a0 expref: 17 pid: 14307 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088598:0:14300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a108920200/0xcbde9110e47c21a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c21a0 expref: 17 pid: 14307 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088612:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a108920200/0xcbde9110e47c21a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c21a0 expref: 17 pid: 14307 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088625:0:14300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c223a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088640:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c223a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788726166.088655:0:14300:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002623551s 00010000:00010000:0.0:1788726166.088660:0:14300:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c223a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088667:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c223a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088673:0:14300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c223a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088679:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c223a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088685:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eac00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:0.0:1788726166.088689:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c223a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088696:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c223a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088717:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c223a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726166.088725:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726166.088755:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:3305:x1875614935120384:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726166.088762:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788726166.088785:0:14329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c223a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726166.088792:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3305:1875614935120384:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788726166.088802:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c223a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726166.088809:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c223a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726166.097895:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+15:14993:x1875614935120128:12345-0@lo:253:mount.lustre.0 Request processed in 52812us (53060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726166.097912:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788726166.097984:0:14993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141deb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14993:1875614935120128:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788726166.097999:0:14993:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788726166.098002:0:14993:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788726166.098003:0:14993:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788726166.098004:0:14993:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788726166.098005:0:14993:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788726166.098006:0:14993:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788726166.098007:0:14993:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788726166.098008:0:14993:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788726166.098010:0:14993:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788726166.098010:0:14993:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788726166.098023:0:14993:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788726166.101130:0:14993:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788726166.101963:0:14993:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788726166.102097:0:14993:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788726166.102205:0:14993:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788726166.102331:0:14993:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788726166.102512:0:14993:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788726166.105341:0:14993:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788726166.150172:0:14993:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788726166.150180:0:14993:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788726166.150239:0:14993:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788726166.150295:0:14993:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788726166.150306:0:14993:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788726166.150330:0:14993:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788726166.485464:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788726166.872397:0:14344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788726167.515434:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788726167.704042:0:14310:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788726167.704050:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91a13ad4c800 from 7 10000000:01000000:3.0:1788726167.704055:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788726167.704115:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a13a915400/0xcbde9110e47c2241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726167.704128:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a13a915400/0xcbde9110e47c2241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726167.704141:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a13a915400/0xcbde9110e47c2241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726167.704168:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935120512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788726167.704260:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726167.704317:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1067f9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788726167.704481:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935120512 00000100:00100000:1.0:1788726167.704489:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935120512 00000100:00100000:1.0:1788726167.704547:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788726167.704557:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+15:14310:x1875614935120512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788726167.704571:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726167.704586:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a108921c00/0xcbde9110e47c2248 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c2241 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726167.704608:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a108921c00/0xcbde9110e47c2248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c2241 expref: 16 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726167.704617:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a108921c00/0xcbde9110e47c2248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c2241 expref: 16 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726167.704627:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921c00, rc 0) 00000100:00100000:1.0:1788726167.704740:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:14310:x1875614935120512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726167.704754:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788726167.706281:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935120512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726167.706314:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a13a915400/0xcbde9110e47c2241 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2248 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726167.706327:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a13a915400/0xcbde9110e47c2241 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c2248 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726167.706389:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935120640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788726167.706454:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726167.706492:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1067f9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788726167.706511:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935120640 00000100:00100000:3.0:1788726167.706517:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935120640 00000100:00100000:3.0:1788726167.706559:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788726167.706569:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:14310:x1875614935120640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788726167.706589:0:14305:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788726167.706606:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788726167.706610:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788726167.706770:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:14310:x1875614935120640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 201us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726167.706778:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788726167.706816:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935120640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788726167.706873:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788726167.706880:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a13a915400/0xcbde9110e47c2241 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2248 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726167.706888:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a13a915400/0xcbde9110e47c2241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2248 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726168.534278:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726169.558382:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726170.581353:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788726171.351588:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726171.351596:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788726171.351599:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726171.351601:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788726171.351666:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935120896:0@lo:400:kworker.0 00000100:00100000:3.0:1788726171.351836:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935120768:0@lo:400:kworker.0 00000100:00100000:3.0:1788726171.353070:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726171.353713:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935120768 00000100:00100000:0.0:1788726171.354481:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935121024:0@lo:400:kworker.0 00000100:00100000:0.0:1788726171.354547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726171.354607:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935121024 00000100:00100000:0.0:1788726171.354614:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935121024 00000100:00100000:0.0:1788726171.354667:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788726171.354677:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935121024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726171.354888:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935120768 00000100:00100000:3.0:1788726171.354922:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788726171.354930:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c02a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:3306:x1875614935120768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726171.354972:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c02a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:3306:x1875614935120768:12345-0@lo:400:kworker.0 Request processed in 43us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726171.354979:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788726171.355348:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935120768:0@lo:400:kworker.0 00000100:00100000:1.0:1788726171.355940:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726171.355995:0:14315:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788726171.356005:0:14315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788726171.356195:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935121024:12345-0@lo:400:kworker.0 Request processed in 1517us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726171.356204:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788726171.356240:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935120896 00000100:00100000:0.0:1788726171.356246:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935120896 00000100:00100000:0.0:1788726171.356270:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788726171.356277:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935120896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726171.356326:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875614935120896:12345-0@lo:400:kworker.0 Request processed in 49us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726171.356332:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788726171.356371:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788726171.356680:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a13ab4aa00 x1875614935121024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726171.356693:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935121024:0@lo:400:kworker.0 00010000:00080000:1.0:1788726171.356953:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a13ab49f80 x1875614935120896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726171.356965:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875614935120896:0@lo:400:kworker.0 00000001:02000400:0.0:1788726171.366185:0:15360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788726171.605680:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726172.629849:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726173.654329:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726174.677393:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726175.707514:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788726176.086274:0:14344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1788726176.470436:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726176.470444:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788726176.470447:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726176.470450:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788726176.470510:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788726176.470532:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3304:1875614935121152:0@lo:400:kworker.0 00000100:00100000:1.0:1788726176.470605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726176.470663:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935121280:0@lo:400:kworker.0 00000100:00100000:1.0:1788726176.470693:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726176.470714:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788726176.470720:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935121408:0@lo:400:kworker.0 00000100:00100000:1.0:1788726176.470741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726176.470772:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935121152 00000100:00100000:1.0:1788726176.470780:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935121152 00000100:00100000:1.0:1788726176.470828:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788726176.470837:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:3304:x1875614935121152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726176.470886:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:3304:x1875614935121152:12345-0@lo:400:kworker.0 Request processed in 50us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726176.470894:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788726176.470923:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935121280 00000100:00100000:1.0:1788726176.470926:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935121280 00000100:00100000:1.0:1788726176.470949:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935121408 00000100:00100000:1.0:1788726176.470952:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935121408 00000100:00100000:1.0:1788726176.470983:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788726176.470989:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935121280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726176.471027:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935121280:12345-0@lo:400:kworker.0 Request processed in 38us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726176.471033:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788726176.471045:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788726176.471051:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935121408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726176.471089:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935121408:12345-0@lo:400:kworker.0 Request processed in 38us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726176.471095:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788726176.471122:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788726176.471147:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a13ab48e00 x1875614935121408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726176.471160:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935121408:0@lo:400:kworker.0 00010000:00080000:1.0:1788726176.471171:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a13ab4aa00 x1875614935121280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726176.471179:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935121280:0@lo:400:kworker.0 00000100:00100000:1.0:1788726176.471209:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3304:1875614935121152:0@lo:400:kworker.0 00010000:00010000:3.0:1788726176.725341:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726177.751702:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788726178.211434:0:15711:0:(obd_mount.c:934:lmd_print()) mount data: 00000020:01000004:3.0:1788726178.211439:0:15711:0:(obd_mount.c:937:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788726178.211593:0:15711:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91a10579f800 00000020:01000004:3.0:1788726178.211609:0:15711:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788726178.211623:0:15711:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788726178.211639:0:15711:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91a103274d28) 00000020:00000080:3.0:1788726178.211657:0:15711:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788726178.240957:0:15711:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788726178.241287:0:15711:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788726178.242378:0:15711:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788726178.242897:0:15711:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788726178.243112:0:15711:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788726178.243829:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:2.0:1788726178.243993:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:2.0:1788726178.244089:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:3.0:1788726178.246980:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 647: rc = 0 00100000:10000000:3.0:1788726178.247338:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 647: rc = 0 00100000:10000000:3.0:1788726178.252872:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 647: rc = 0 00100000:10000000:3.0:1788726178.253192:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 647: rc = 0 00100000:10000000:3.0:1788726178.255187:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 647: rc = 0 00100000:10000000:3.0:1788726178.256071:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 647: rc = 0 00000020:00000080:3.0:1788726178.257026:0:15711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788726178.257040:0:15711:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788726178.257051:0:15711:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcbde9110e47c2256 00000020:01000004:3.0:1788726178.257060:0:15711:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788726178.257085:0:15711:0:(obd_mount.c:414:lustre_start_mgc()) MGC192.168.201.142@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788726178.257089:0:15711:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788726178.257094:0:15711:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788726178.257119:0:15711:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788726178.257123:0:15711:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.142@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788726178.278211:0:15711:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.142@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788726178.278303:0:15711:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.142@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788726178.278308:0:15711:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788726178.278310:0:15711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788726178.278311:0:15711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788726178.278312:0:15711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788726178.278314:0:15711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788726178.278315:0:15711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788726178.278316:0:15711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788726178.278318:0:15711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788726178.278320:0:15711:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788726178.278323:0:15711:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788726178.278325:0:15711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788726178.278327:0:15711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788726178.278328:0:15711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788726178.278329:0:15711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788726178.278330:0:15711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788726178.278331:0:15711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788726178.278332:0:15711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788726178.278333:0:15711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788726178.278334:0:15711:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788726178.278370:0:15711:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788726178.278393:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935121536:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788726178.281707:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726178.281793:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1129f9240 going to sleep for 11 seconds 00000100:00100000:3.0:1788726178.281990:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935121536 00000100:00100000:3.0:1788726178.282000:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935121536 00000100:00100000:3.0:1788726178.282056:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788726178.282065:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c02b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:15711:x1875614935121536:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788726178.282118:0:14305:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788726178.282121:0:14305:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788726178.282125:0:14305:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788726178.295848:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c02b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:15711:x1875614935121536:12345-0@lo:253:mount.lustre.0 Request processed in 13771us (14135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726178.295866:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788726178.295978:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935121536:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788726178.295994:0:15711:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788726178.295998:0:15711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788726178.296000:0:15711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788726178.296002:0:15711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788726178.296003:0:15711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788726178.296004:0:15711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788726178.296006:0:15711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788726178.296007:0:15711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788726178.296009:0:15711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788726178.296010:0:15711:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788726178.296048:0:15711:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91a10579f800 from lustre-OST0001 10000000:01000000:0.0:1788726178.296072:0:15711:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788726178.296075:0:15711:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788726178.296082:0:15711:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91a110b48000 local copy 00010000:00010000:0.0:1788726178.296093:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c20c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c20ce expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726178.296973:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935121664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788726178.297026:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726178.297121:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a107bb3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788726178.297173:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935121664 00000100:00100000:3.0:1788726178.297181:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935121664 00000100:00100000:3.0:1788726178.297355:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788726178.300181:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c02b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:15711:x1875614935121664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726178.307989:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c02b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:15711:x1875614935121664:12345-0@lo:501:mount.lustre.0 Request processed in 10617us (10953us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788726178.308004:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788726178.308388:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935121664:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788726178.308412:0:15711:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788726178.308729:0:15711:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788726178.310346:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c20c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c20ce expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726178.310359:0:15711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e725800/0xcbde9110e47c20c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c20ce expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726178.310424:0:15711:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91a10579f800 10000000:01000000:1.0:1788726178.310443:0:15711:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788726178.310450:0:15711:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788726178.310453:0:15711:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788726178.310458:0:15711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788726178.310460:0:15711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788726178.310571:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a108921a00/0xcbde9110e47c225d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726178.310580:0:15711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a108921a00/0xcbde9110e47c225d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726178.310591:0:15711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a108921a00/0xcbde9110e47c225d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726178.310614:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935121792:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788726178.310678:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726178.310929:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a107bb3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788726178.314679:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935121792 00000100:00100000:3.0:1788726178.314697:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935121792 00000100:00100000:2.0:1788726178.324482:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788726178.324502:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:15711:x1875614935121792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726178.324520:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726178.324537:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a1398eb000/0xcbde9110e47c2264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c225d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726178.324568:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398eb000/0xcbde9110e47c2264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c225d expref: 17 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726178.324578:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a1398eb000/0xcbde9110e47c2264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c225d expref: 17 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726178.324589:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eb000, rc 0) 00000100:00100000:2.0:1788726178.324668:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:15711:x1875614935121792:12345-0@lo:101:mount.lustre.0 Request processed in 170us (13990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726178.324675:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788726178.324964:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935121792:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726178.324984:0:15711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a108921a00/0xcbde9110e47c225d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2264 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726178.324995:0:15711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a108921a00/0xcbde9110e47c225d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c2264 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788726178.325890:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788726178.332124:0:15711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788726178.332594:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788726178.332645:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788726178.332681:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788726178.332806:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788726178.332851:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788726178.332887:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788726178.332953:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788726178.332960:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788726178.333053:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935121920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788726178.333117:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726178.333202:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a107bb3840 going to sleep for 11 seconds 00000100:00100000:0.0:1788726178.334071:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935121920 00000100:00100000:0.0:1788726178.334081:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935121920 00000100:00100000:1.0:1788726178.334192:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788726178.334203:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:15711:x1875614935121920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788726178.335120:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:15711:x1875614935121920:12345-0@lo:501:mount.lustre.0 Request processed in 915us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726178.335131:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788726178.335276:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935121920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726178.335328:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122048:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726178.335376:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726178.335402:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1128ad180 going to sleep for 11 seconds 00000100:00100000:1.0:1788726178.335588:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935122048 00000100:00100000:1.0:1788726178.335594:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935122048 00000100:00100000:1.0:1788726178.335635:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788726178.335643:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c02a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:15711:x1875614935122048:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788726178.336125:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c02a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:15711:x1875614935122048:12345-0@lo:503:mount.lustre.0 Request processed in 481us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726178.336134:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788726178.336376:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122048:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788726178.338077:0:15711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788726178.338185:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726178.338370:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726178.338479:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a107bb3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788726178.338869:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935122176 00000100:00100000:2.0:1788726178.338880:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935122176 00000100:00100000:2.0:1788726178.338990:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788726178.339000:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c02b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:15711:x1875614935122176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726178.339306:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c02b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:15711:x1875614935122176:12345-0@lo:502:mount.lustre.0 Request processed in 306us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726178.339316:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788726178.339416:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788726178.339717:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788726178.339773:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788726178.339809:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788726178.339858:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788726178.339899:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788726178.339934:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788726178.339986:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788726178.340025:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788726178.340074:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788726178.340116:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122304:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726178.340166:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726178.340669:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a0077713c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726178.340771:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935122304 00000100:00100000:3.0:1788726178.340779:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935122304 00000100:00100000:3.0:1788726178.340824:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788726178.340834:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c02bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:15711:x1875614935122304:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788726178.341042:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c02bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:15711:x1875614935122304:12345-0@lo:502:mount.lustre.0 Request processed in 210us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726178.341050:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788726178.341140:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788726178.341240:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788726178.341262:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788726178.342194:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788726178.342203:0:15712:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788726178.342209:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726178.342212:0:15712:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788726178.342233:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788726178.342260:0:15712:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff91a1111d19b8) 00000020:00000080:1.0:1788726178.342285:0:15712:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788726178.342291:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788726178.342365:0:15712:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a10579f800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788726178.342373:0:15712:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788726178.342381:0:15712:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcbde9110e47c2272 00010000:00010000:1.0:1788726178.354818:0:15712:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788726178.355323:0:15712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788726178.365302:0:15712:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788726178.367285:0:15712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788726178.367299:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788726178.367307:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726178.367309:0:15712:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788726178.367314:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788726178.367318:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726178.367320:0:15712:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788726178.367323:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788726178.367325:0:15712:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788726178.367327:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788726178.367329:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726178.367330:0:15712:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788726178.367332:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788726178.367335:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726178.367336:0:15712:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788726178.367352:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788726178.367409:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788726178.367411:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726178.367413:0:15712:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788726178.367416:0:15712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788726178.367668:0:15711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788726178.367703:0:15711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788726178.367729:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a108921a00/0xcbde9110e47c225d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2264 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726178.367753:0:15711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a108921a00/0xcbde9110e47c225d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2264 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726178.367762:0:15711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a10579f800 from 1 10000000:01000000:0.0:1788726178.367765:0:15711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788726178.367801:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c2279 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726178.367808:0:15711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c2279 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726178.367818:0:15711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c2279 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726178.367841:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122432:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788726178.367909:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726178.367952:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1128ad180 going to sleep for 11 seconds 00000100:00100000:2.0:1788726178.369311:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935122432 00000100:00100000:2.0:1788726178.369325:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935122432 00000100:00100000:2.0:1788726178.369393:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788726178.369403:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:15711:x1875614935122432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726178.369419:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726178.369435:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a1398ea200/0xcbde9110e47c2280 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c2279 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726178.369473:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398ea200/0xcbde9110e47c2280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c2279 expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726178.369494:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a1398ea200/0xcbde9110e47c2280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c2279 expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726178.369504:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea200, rc 0) 00000100:00100000:2.0:1788726178.369569:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:15711:x1875614935122432:12345-0@lo:101:mount.lustre.0 Request processed in 167us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726178.369575:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788726178.369966:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726178.369986:0:15711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c2279 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2280 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726178.369995:0:15711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c2279 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c2280 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788726178.370702:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788726178.375937:0:15711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788726178.376292:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788726178.376335:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788726178.376410:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788726178.376419:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788726178.376520:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726178.376582:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726178.376628:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1128ad180 going to sleep for 11 seconds 00000100:00100000:1.0:1788726178.376732:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935122560 00000100:00100000:1.0:1788726178.376740:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935122560 00000100:00100000:1.0:1788726178.376782:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788726178.376791:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:15711:x1875614935122560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788726178.377010:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:15711:x1875614935122560:12345-0@lo:501:mount.lustre.0 Request processed in 218us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726178.377018:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788726178.377700:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726178.377744:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122688:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726178.377795:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726178.377856:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1128ad180 going to sleep for 11 seconds 00000100:00100000:1.0:1788726178.387364:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935122688 00000100:00100000:1.0:1788726178.387382:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935122688 00000100:00100000:1.0:1788726178.387447:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788726178.387468:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c02ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:15711:x1875614935122688:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788726178.387730:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c02ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:15711:x1875614935122688:12345-0@lo:503:mount.lustre.0 Request processed in 273us (9932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726178.387739:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788726178.393419:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122688:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788726178.394193:0:15711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788726178.394320:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726178.394394:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726178.394437:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1070e53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726178.395583:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935122816 00000100:00100000:2.0:1788726178.395593:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935122816 00000100:00100000:2.0:1788726178.395655:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788726178.395666:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:15711:x1875614935122816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726178.395877:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:15711:x1875614935122816:12345-0@lo:502:mount.lustre.0 Request processed in 212us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726178.395884:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788726178.395993:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122816:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788726178.396268:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788726178.396319:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788726178.396369:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788726178.396404:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788726178.396451:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788726178.396499:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788726178.396535:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788726178.396568:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788726178.396603:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726178.396652:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726178.396681:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a109560b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788726178.396780:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935122944 00000100:00100000:3.0:1788726178.396786:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935122944 00000100:00100000:3.0:1788726178.396811:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788726178.396818:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:15711:x1875614935122944:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788726178.396960:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:15711:x1875614935122944:12345-0@lo:502:mount.lustre.0 Request processed in 141us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726178.396968:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788726178.397184:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935122944:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788726178.397310:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788726178.397321:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788726178.406176:0:15716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788726178.406192:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726178.406194:0:15716:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788726178.406203:0:15716:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a10579f800 00000020:00000080:0.0:1788726178.406205:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788726178.406212:0:15716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726178.406406:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726178.406408:0:15716:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788726178.406412:0:15716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788726178.406415:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726178.406416:0:15716:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788726178.406419:0:15716:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91a10579f800 00000020:00000080:0.0:1788726178.406421:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788726178.406564:0:15716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726178.406568:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726178.406570:0:15716:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788726178.406573:0:15716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788726178.406576:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726178.406577:0:15716:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788726178.406580:0:15716:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91a10579f800 00000020:00000080:0.0:1788726178.406582:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788726178.409528:0:15716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726178.409541:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726178.409544:0:15716:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788726178.409549:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788726178.409689:0:15711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788726178.409719:0:15711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788726178.409742:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c2279 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2280 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.409755:0:15711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c2279 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2280 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726178.409803:0:15711:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788726178.409806:0:15711:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91a10579f800 10000000:01000000:3.0:1788726178.409809:0:15711:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91a10579f800 10000000:01000000:3.0:1788726178.409813:0:15711:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788726178.409819:0:15711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91a10579f800 from 1 10000000:01000000:3.0:1788726178.409822:0:15711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788726178.409862:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a13a914e00/0xcbde9110e47c2287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.409882:0:15711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a13a914e00/0xcbde9110e47c2287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.409895:0:15711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a13a914e00/0xcbde9110e47c2287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726178.409921:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935123072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788726178.409999:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726178.410046:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13aed0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788726178.410275:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935123072 00000100:00100000:0.0:1788726178.410283:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935123072 00000100:00100000:0.0:1788726178.410329:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788726178.410339:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:15711:x1875614935123072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726178.410353:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726178.410365:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a10e724400/0xcbde9110e47c228e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c2287 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726178.410389:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a10e724400/0xcbde9110e47c228e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c2287 expref: 19 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726178.410399:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a10e724400/0xcbde9110e47c228e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c2287 expref: 19 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726178.410408:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a10e724400, rc 0) 00000100:00100000:0.0:1788726178.410604:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:15711:x1875614935123072:12345-0@lo:101:mount.lustre.0 Request processed in 116us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726178.410611:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788726178.410681:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935123072:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726178.410695:0:15711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a13a914e00/0xcbde9110e47c2287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c228e expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726178.410705:0:15711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a13a914e00/0xcbde9110e47c2287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c228e expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788726178.412128:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788726178.413061:0:15711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788726178.413667:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788726178.413810:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788726178.413849:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788726178.413912:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788726178.413950:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788726178.414012:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788726178.414051:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788726178.414088:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788726178.414139:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788726178.414179:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788726178.414419:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788726178.414480:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788726178.414519:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788726178.414554:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788726178.414605:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788726178.414642:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788726178.414678:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788726178.414724:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788726178.414822:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788726178.414864:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788726178.414915:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788726178.414948:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788726178.414983:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788726178.415032:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788726178.415068:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788726178.415100:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788726178.415149:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788726178.415192:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788726178.415269:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788726178.415324:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788726178.415363:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788726178.415398:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788726178.415454:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788726178.415504:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788726178.415542:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788726178.415590:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788726178.415626:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788726178.415712:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788726178.415720:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788726178.417954:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935123200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726178.418025:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726178.418073:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1128adcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726178.418104:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935123200 00000100:00100000:0.0:1788726178.418111:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935123200 00000100:00100000:0.0:1788726178.418164:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788726178.418173:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1117ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:15711:x1875614935123200:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726178.418471:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1117ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:15711:x1875614935123200:12345-0@lo:501:mount.lustre.0 Request processed in 298us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726178.418480:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788726178.418531:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935123200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726178.418563:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935123328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726178.418598:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726178.418613:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1128adcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726178.418628:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935123328 00000100:00100000:0.0:1788726178.418631:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935123328 00000100:00100000:0.0:1788726178.418651:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788726178.418657:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:15711:x1875614935123328:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726178.422416:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:15711:x1875614935123328:12345-0@lo:503:mount.lustre.0 Request processed in 3745us (3804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726178.422446:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788726178.422533:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935123328:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788726178.423079:0:15711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788726178.423163:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935123456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726178.423931:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726178.423990:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1128adcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726178.424080:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935123456 00000100:00100000:1.0:1788726178.424090:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935123456 00000100:00100000:1.0:1788726178.424145:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788726178.424156:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:15711:x1875614935123456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726178.424440:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:15711:x1875614935123456:12345-0@lo:502:mount.lustre.0 Request processed in 285us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726178.424448:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788726178.429455:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935123456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788726178.430916:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788726178.431002:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788726178.431037:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788726178.431090:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788726178.431128:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788726178.431180:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788726178.431239:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788726178.431310:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788726178.431372:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788726178.431413:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788726178.431448:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788726178.431497:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788726178.431533:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788726178.431570:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788726178.431625:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788726178.431664:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788726178.431716:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788726178.431791:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788726178.431830:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788726178.431866:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788726178.431918:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788726178.431964:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788726178.432000:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788726178.432059:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788726178.432106:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788726178.432141:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788726178.432189:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788726178.432265:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788726178.432311:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788726178.432376:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788726178.432420:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788726178.432461:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788726178.432525:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788726178.432582:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788726178.432625:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788726178.432684:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788726178.432718:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788726178.432754:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788726178.432803:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788726178.432837:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788726178.432883:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935123584:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726178.432962:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726178.433018:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935123584 00000100:00100000:0.0:1788726178.433025:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935123584 00000100:00100000:0.0:1788726178.433077:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788726178.433087:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:15711:x1875614935123584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726178.436992:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:15711:x1875614935123584:12345-0@lo:502:mount.lustre.0 Request processed in 3896us (4019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726178.437009:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788726178.437097:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1128adcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726178.437123:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935123584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788726178.437288:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788726178.437371:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788726178.441170:0:15721:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788726178.441189:0:15721:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91a112968000) 00000020:00000080:1.0:1788726178.441210:0:15721:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788726178.441325:0:15721:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a10579f800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788726178.441330:0:15721:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91a10579f800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788726178.441333:0:15721:0:(obd_mount.c:721:lustre_put_lsi()) put ffff91a10579f800 3 00010000:00080000:1.0:1788726178.441365:0:15721:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91a102a1e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.142@tcp at head 00010000:00010000:1.0:1788726178.449947:0:15721:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788726178.450171:0:15721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788726178.450210:0:15721:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788726178.450261:0:15721:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcbde9110e47c229c 00000100:00080000:1.0:1788726178.450282:0:15721:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788726178.450289:0:15721:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91a102a1e800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:1.0:1788726178.450326:0:15721:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a13ab4ad80 x1875614935123712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788726178.450353:0:15721:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788726178.450384:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726178.450388:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788726178.450390:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726178.450393:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788726178.450439:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935123840:0@lo:400:kworker.0 00000100:00100000:1.0:1788726178.450498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726178.450537:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788726178.450543:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935123968:0@lo:400:kworker.0 00000100:00100000:1.0:1788726178.450562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726178.450592:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935123840 00000100:00100000:1.0:1788726178.450599:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935123840 00000100:00100000:1.0:1788726178.450633:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935123968 00000100:00100000:1.0:1788726178.450636:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935123968 00000100:00100000:1.0:1788726178.450660:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788726178.450668:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935123840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726178.450714:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935123840:12345-0@lo:400:kworker.0 Request processed in 46us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726178.450720:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788726178.450733:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788726178.450739:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935123968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726178.450763:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935123968:12345-0@lo:400:kworker.0 Request processed in 25us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726178.450769:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788726178.450789:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788726178.450813:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a13ab4aa00 x1875614935123968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726178.450827:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935123968:0@lo:400:kworker.0 00010000:00080000:1.0:1788726178.450837:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a13ab48e00 x1875614935123840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726178.450845:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935123840:0@lo:400:kworker.0 00000100:00100000:0.0:1788726178.450876:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875614935123712:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788726178.450909:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726178.451734:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935123712 00000100:00100000:2.0:1788726178.451741:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935123712 00000100:00100000:2.0:1788726178.451782:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788726178.451788:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3303:x1875614935123712:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788726178.451811:0:15361:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:2.0:1788726178.451846:0:15361:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcbde9110e47c22a3 00000004:00100000:2.0:1788726178.451862:0:15361:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788726178.451892:0:15361:0:(import.c:65:import_set_state_nolock()) ffff91a13a56a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788726178.451957:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875614935123712:12345-0@lo:38:llog_process_th.0 Request processed in 167us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726178.451964:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788726178.452163:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91a13ab4ad80 x1875614935123712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788726188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726178.452173:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788726178.452179:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788726178.452186:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788726178.452189:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788726178.452192:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a102a1e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788726178.452197:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875614935123712:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788726178.452888:0:15721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788726178.453869:0:15711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788726178.453912:0:15711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788726178.453939:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a13a914e00/0xcbde9110e47c2287 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c228e expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.453950:0:15711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a13a914e00/0xcbde9110e47c2287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c228e expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788726178.454011:0:15711:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788726178.454030:0:15711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788726178.454031:0:15711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788726178.454032:0:15711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788726178.454033:0:15711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788726178.454035:0:15711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788726178.454036:0:15711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788726178.454038:0:15711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788726178.454039:0:15711:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788726178.454042:0:15711:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788726178.454044:0:15711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788726178.454045:0:15711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788726178.454046:0:15711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788726178.454047:0:15711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788726178.454048:0:15711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788726178.454049:0:15711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788726178.454050:0:15711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788726178.454051:0:15711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788726178.454052:0:15711:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788726178.454075:0:15711:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788726178.454094:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935124096:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788726178.454158:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726178.454198:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a133af3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788726178.454771:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935124096 00000100:00100000:1.0:1788726178.454789:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935124096 00000100:00100000:1.0:1788726178.454835:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788726178.454845:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:15711:x1875614935124096:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788726178.454869:0:14307:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788726178.454885:0:14307:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788726178.518797:0:14307:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788726178.518835:0:14307:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788726178.519108:0:14329:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788726178.519113:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788726178.519136:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a13a915800/0xcbde9110e47c22aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.519154:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a108921c00/0xcbde9110e47c2248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c2241 expref: 19 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.519163:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a13a915800/0xcbde9110e47c22aa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.519204:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a108921c00/0xcbde9110e47c2248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c2241 expref: 19 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.519486:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a108921c00/0xcbde9110e47c2248 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c2241 expref: 19 pid: 14307 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726178.519502:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14329:1875614935124224:0@lo:104: 00000100:00100000:3.0:1788726178.519567:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726178.519620:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13aed0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788726178.519995:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935124224 00000100:00100000:2.0:1788726178.520003:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935124224 00000100:00100000:2.0:1788726178.520116:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788726178.520126:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+3:14329:x1875614935124224:12345-0@lo:104: 00010000:00010000:2.0:1788726178.520140:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a13a915400/0xcbde9110e47c2241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c2248 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726178.520213:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788726178.520262:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+3:14329:x1875614935124224:12345-0@lo:104: Request processed in 137us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726178.520277:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788726178.520288:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14329:1875614935124224:0@lo:104: 00010000:00010000:1.0:1788726178.520312:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a13a915800/0xcbde9110e47c22aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726178.520359:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726178.520366:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a13a915400/0xcbde9110e47c2241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c2248 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726178.520376:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915400 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:2.0:1788726178.520381:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a13a915400/0xcbde9110e47c2241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c2248 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726178.520389:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a13a915400/0xcbde9110e47c2241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c2248 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788726178.520397:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a13a915400/0xcbde9110e47c2241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c2248 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726178.520403:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788726178.523265:0:14302:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a13a915400/0xcbde9110e47c2241 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c2248 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.523284:0:14302:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788726178.523304:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a13a915400/0xcbde9110e47c2241 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c2248 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.523313:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a13a915400/0xcbde9110e47c2241 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c2248 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.523334:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726178.523335:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935124352:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788726178.523338:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726178.523342:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726178.523410:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726178.523917:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935124352 00000100:00100000:3.0:1788726178.523925:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935124352 00010000:00010000:3.0:1788726178.523954:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a108921c00/0xcbde9110e47c2248 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c2241 expref: 20 pid: 14307 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726178.523987:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788726178.523996:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+20:3306:x1875614935124352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788726178.524008:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726178.524013:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a108921c00/0xcbde9110e47c2248 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c2241 expref: 20 pid: 14307 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.524040:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a108921c00/0xcbde9110e47c2248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c2241 expref: 20 pid: 14307 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.524054:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a108921c00/0xcbde9110e47c2248 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c2241 expref: 20 pid: 14307 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.524069:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a13a915800/0xcbde9110e47c22aa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.524078:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a13a915800/0xcbde9110e47c22aa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788726178.524093:0:14298:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004979777s 00010000:00010000:3.0:1788726178.524097:0:14298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a13a915800/0xcbde9110e47c22aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.524104:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a13a915800/0xcbde9110e47c22aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.524111:0:14298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a13a915800/0xcbde9110e47c22aa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.524119:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a13a915800/0xcbde9110e47c22aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.524125:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915800 already unused, calling callback (ffffffffc142a230) 00010000:00010000:3.0:1788726178.524129:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a13a915800/0xcbde9110e47c22aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.524136:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a13a915800/0xcbde9110e47c22aa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.524157:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a13a915800/0xcbde9110e47c22aa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726178.524167:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726178.524211:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:3306:x1875614935124352:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726178.524267:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788726178.530342:0:14329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a13a915800/0xcbde9110e47c22aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726178.530363:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a13a915800/0xcbde9110e47c22aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726178.530371:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a13a915800/0xcbde9110e47c22aa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726178.530435:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935124352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788726178.539192:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:15711:x1875614935124096:12345-0@lo:253:mount.lustre.0 Request processed in 84338us (85023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726178.539209:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788726178.539348:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:15711:1875614935124096:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788726178.539368:0:15711:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788726178.539371:0:15711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788726178.539374:0:15711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788726178.539375:0:15711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788726178.539377:0:15711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788726178.539378:0:15711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788726178.539391:0:15711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788726178.539392:0:15711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788726178.539394:0:15711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788726178.539396:0:15711:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788726178.539425:0:15711:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788726178.548115:0:15711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788726178.548351:0:15711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788726178.548848:0:15711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788726178.549127:0:15711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788726178.549325:0:15711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788726178.551121:0:15711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788726178.553344:0:15711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788726178.614093:0:15711:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788726178.614102:0:15711:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788726178.614145:0:15711:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788726178.614208:0:15711:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.142@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788726178.614252:0:15711:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788726178.614283:0:15711:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788726178.774328:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726179.485613:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726164/real 1788726164] req@ffff91a13ab48000 x1875614935117184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726179 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726179.485647:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91a13ab48000 x1875614935117184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726179 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726179.485657:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726164/real 1788726164] req@ffff91a13ab4a680 x1875614935117312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726179 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726179.485786:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91a13ab4a680 x1875614935117312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726179 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788726179.485804:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a105797000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788726179.488287:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788726179.488298:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935117184:0@lo:8:kworker.0 00000100:00080000:3.0:1788726179.488309:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a105788800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788726179.493053:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788726179.493075:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788726179.493079:0:36:0:(import.c:65:import_set_state_nolock()) ffff91a105797000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788726179.493087:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1788726179.493093:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788726179.493099:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91a105797000 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788726179.493122:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a141c48380 x1875614935124608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788726179.493134:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788726179.493137:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788726179.493139:0:36:0:(import.c:65:import_set_state_nolock()) ffff91a105788800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788726179.493142:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1788726179.493144:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788726179.493147:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91a105788800 using connection 192.168.201.142@tcp/0@lo 00000100:00100000:0.0:1788726179.493158:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91a141c4ad80 x1875614935124736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788726179.493248:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3307:1875614935124480:0@lo:400:kworker.0 00000100:00100000:0.0:1788726179.493323:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726179.493378:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788726179.493384:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935125120:0@lo:400:kworker.0 00000100:00100000:0.0:1788726179.493679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726179.493717:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935124864:0@lo:400:kworker.0 00000100:00100000:0.0:1788726179.493741:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726179.493761:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788726179.493767:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935124992:0@lo:400:kworker.0 00000100:00100000:0.0:1788726179.493788:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726179.493820:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935124480 00000100:00100000:0.0:1788726179.493827:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935124480 00000100:00100000:0.0:1788726179.493872:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788726179.493880:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:3307:x1875614935124480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726179.493928:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:3307:x1875614935124480:12345-0@lo:400:kworker.0 Request processed in 49us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726179.493935:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788726179.493967:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935125120 00000100:00100000:0.0:1788726179.493970:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935125120 00000100:00100000:0.0:1788726179.494004:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935124864 00000100:00100000:0.0:1788726179.494007:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935124864 00000100:00100000:0.0:1788726179.494020:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935124992 00000100:00100000:0.0:1788726179.494022:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935124992 00000100:00100000:0.0:1788726179.494033:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788726179.494038:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935125120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726179.494330:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935125120:12345-0@lo:400:kworker.0 Request processed in 290us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726179.494337:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788726179.494351:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788726179.494357:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935124864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726179.494388:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935124864:12345-0@lo:400:kworker.0 Request processed in 31us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726179.494401:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788726179.494784:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788726179.494793:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935124992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726179.494824:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875614935124992:12345-0@lo:400:kworker.0 Request processed in 33us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726179.494831:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788726179.494876:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a141c49880 x1875614935125120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726179.494890:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935125120:0@lo:400:kworker.0 00000100:00100000:0.0:1788726179.494900:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3307:1875614935124480:0@lo:400:kworker.0 00000100:00080000:0.0:1788726179.494920:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788726179.494940:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a141c4b800 x1875614935124992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726179.494949:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875614935124992:0@lo:400:kworker.0 00010000:00080000:0.0:1788726179.494958:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a141c4aa00 x1875614935124864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726179.494965:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935124864:0@lo:400:kworker.0 00000100:00080000:3.0:1788726179.501597:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788726179.501611:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935117312:0@lo:8:kworker.0 00000100:00100000:3.0:1788726179.501660:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935124608:0@lo:8:kworker.0 00000100:00100000:3.0:1788726179.501743:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726179.501791:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935124736:0@lo:8:kworker.0 00000100:00100000:3.0:1788726179.501833:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726179.501896:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935124608 00000100:00100000:3.0:1788726179.501904:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935124608 00000100:00100000:3.0:1788726179.501929:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935124736 00000100:00100000:3.0:1788726179.501932:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935124736 00000100:00100000:3.0:1788726179.501943:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788726179.501950:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875614935124608:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788726179.501979:0:14995:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:3.0:1788726179.502011:0:14995:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbde9110e47c22b1 00002000:00100000:3.0:1788726179.502026:0:14995:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91a006302000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788726179.502031:0:14995:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788726179.502034:0:14995:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788726179.503137:0:14995:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788726179.503168:0:14995:0:(import.c:65:import_set_state_nolock()) ffff91a006305000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788726179.503268:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875614935124608:12345-0@lo:8:kworker.0 Request processed in 1316us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726179.503278:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788726179.503304:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788726179.503310:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875614935124736:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788726179.503332:0:14995:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:3.0:1788726179.503358:0:14995:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbde9110e47c22b8 00002000:00100000:3.0:1788726179.503368:0:14995:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91a006301000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788726179.503384:0:14995:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788726179.503387:0:14995:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1788726179.503542:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a141c48380 x1875614935124608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788726199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726179.503554:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788726179.503563:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788726179.503571:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788726179.503576:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788726179.503585:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a105797000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788726179.503604:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788726179.503610:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935124608:0@lo:8:kworker.0 00002000:00080000:3.0:1788726179.506177:0:14995:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788726179.506246:0:14995:0:(import.c:65:import_set_state_nolock()) ffff91a006304800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788726179.506345:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875614935124736:12345-0@lo:8:kworker.0 Request processed in 3031us (4509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726179.506356:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:3.0:1788726179.506399:0:14335:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:0.0:1788726179.506638:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a141c4ad80 x1875614935124736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788726199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726179.506650:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788726179.506657:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788726179.506678:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788726179.506684:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788726179.506686:0:3303:0:(import.c:65:import_set_state_nolock()) ffff91a105788800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788726179.506709:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788726179.506714:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875614935124736:0@lo:8:kworker.0 00000004:00080000:0.0:1788726179.507631:0:14337:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788726179.507997:0:14337:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 474557780494ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788726179.508393:0:14335:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 474558176708ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788726179.509731:0:14336:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788726179.509773:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c48380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14336:1875614935125376:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788726179.509842:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726179.509875:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a1128ad180 going to sleep for 11 seconds 00000100:00100000:0.0:1788726179.509925:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788726179.509937:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935125248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788726179.509964:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726179.510012:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935125376 00000100:00100000:0.0:1788726179.510020:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935125376 00000100:00100000:0.0:1788726179.510089:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788726179.510098:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14336:x1875614935125376:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788726179.510614:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935125248 00000100:00100000:1.0:1788726179.510620:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935125248 00000100:00100000:1.0:1788726179.510659:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788726179.510667:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875614935125248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788726179.510694:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788726179.510746:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875614935125248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726179.510753:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:3.0:1788726179.511772:0:14338:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788726179.511800:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111dad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14338:1875614935125632:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788726179.511845:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726179.511870:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a007771cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726179.511886:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788726179.511896:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935125504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788726179.511919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726179.511945:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788726179.511952:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788726179.511971:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935125504 00000100:00100000:3.0:1788726179.511976:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935125504 00000100:00100000:3.0:1788726179.512007:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788726179.512015:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875614935125504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788726179.512031:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788726179.512067:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875614935125504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726179.512074:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788726179.512185:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a1111d8700 x1875614935125504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726179.512243:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935125504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788726179.512287:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935125632 00000100:00100000:3.0:1788726179.512291:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935125632 00000100:00100000:3.0:1788726179.512363:0:15759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788726179.512370:0:15759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14338:x1875614935125632:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1788726179.515179:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788726179.515196:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788726179.515275:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a141c4ad80 x1875614935125248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726179.515300:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935125248:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1788726179.528620:0:14996:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788726179.528632:0:14996:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788726179.528637:0:14996:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00080000:3.0:1788726179.530811:0:15759:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788726179.530820:0:15759:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788726179.530826:0:15759:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1788726179.543948:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.543960:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf7b91/0xcbde9110e47c22bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.543977:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.543981:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.543987:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf7b91/0xcbde9110e47c22bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.544004:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf7b91/0xcbde9110e47c22bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.544016:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf7b91/0xcbde9110e47c22bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.544024:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf7b91/0xcbde9110e47c22bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.545334:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788726179.547193:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.547213:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c22c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.547263:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.547268:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.547277:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c22c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.547293:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c22c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.547304:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c22c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.547312:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c22c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.550676:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788726179.550691:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6cf7b91/0xcbde9110e47c22bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.550703:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725600 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.550709:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf7b91/0xcbde9110e47c22bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.550718:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf7b91/0xcbde9110e47c22bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.550744:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6cf7b91/0xcbde9110e47c22bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.550751:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf7b91/0xcbde9110e47c22bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.550771:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726179.550774:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c22c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.550794:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.550798:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c22c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.550817:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c22c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.550829:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c22c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.550838:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.550840:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.550842:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788726179.551571:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.551581:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c22cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.551595:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.551600:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.551606:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c22cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.551621:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c22cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.551630:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c22cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.551637:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c22cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.551665:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788726179.552096:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.552100:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c22d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.552106:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.552109:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.552111:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c22d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.552117:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c22d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.552122:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c22d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.552127:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c22d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.552137:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788726179.552145:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788726179.552149:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c22cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.552153:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:3.0:1788726179.552160:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c22cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.552167:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c22cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.552177:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c22cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.552182:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c22cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.552191:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726179.552193:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c22d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.552197:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914200 already unused, calling callback (ffffffffc142a230) 00010000:00010000:3.0:1788726179.552199:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c22d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.552203:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c22d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.552208:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c22d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.552211:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c22d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.552277:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726179.552279:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726179.552281:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.552323:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726179.553469:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788726179.553492:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a8f7ad3/0xcbde9110e47c22c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726179.554171:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.554179:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c22db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.554191:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.554195:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.554208:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c22db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.554263:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c22db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.554274:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c22db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.554281:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c22db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.554305:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788726179.554720:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.554727:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac2d2b04/0xcbde9110e47c22e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.554736:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.554739:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.554744:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2d2b04/0xcbde9110e47c22e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.554753:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac2d2b04/0xcbde9110e47c22e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.554761:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac2d2b04/0xcbde9110e47c22e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.554780:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2d2b04/0xcbde9110e47c22e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.554789:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788726179.555162:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.555168:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096fe72bd/0xcbde9110e47c22e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.555176:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.555179:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.555183:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096fe72bd/0xcbde9110e47c22e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.555192:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096fe72bd/0xcbde9110e47c22e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.555200:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096fe72bd/0xcbde9110e47c22e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.555207:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096fe72bd/0xcbde9110e47c22e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.555250:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788726179.555677:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.555683:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc44e366/0xcbde9110e47c22f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.555696:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.555699:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.555704:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc44e366/0xcbde9110e47c22f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.555712:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc44e366/0xcbde9110e47c22f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.555720:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc44e366/0xcbde9110e47c22f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.555727:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc44e366/0xcbde9110e47c22f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.555734:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788726179.556112:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.556118:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c872b8c4/0xcbde9110e47c22f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.556127:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.556130:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.556135:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c872b8c4/0xcbde9110e47c22f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.556143:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c872b8c4/0xcbde9110e47c22f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.556163:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c872b8c4/0xcbde9110e47c22f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.556171:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c872b8c4/0xcbde9110e47c22f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.556179:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788726179.556574:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788726179.556582:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c22db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556591:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725000 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.556595:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c22db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556604:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c22db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556625:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c22db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556634:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000059d9dba/0xcbde9110e47c22db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556652:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788726179.556656:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac2d2b04/0xcbde9110e47c22e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556670:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724200 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.556673:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac2d2b04/0xcbde9110e47c22e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556681:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac2d2b04/0xcbde9110e47c22e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556692:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac2d2b04/0xcbde9110e47c22e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556700:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac2d2b04/0xcbde9110e47c22e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556713:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788726179.556716:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096fe72bd/0xcbde9110e47c22e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556722:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724000 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.556725:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096fe72bd/0xcbde9110e47c22e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556732:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096fe72bd/0xcbde9110e47c22e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556742:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096fe72bd/0xcbde9110e47c22e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556757:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096fe72bd/0xcbde9110e47c22e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556769:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788726179.556772:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc44e366/0xcbde9110e47c22f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556778:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724e00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.556781:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc44e366/0xcbde9110e47c22f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556787:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc44e366/0xcbde9110e47c22f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556796:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc44e366/0xcbde9110e47c22f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556803:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc44e366/0xcbde9110e47c22f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556813:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726179.556816:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c872b8c4/0xcbde9110e47c22f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556821:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724800 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.556830:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c872b8c4/0xcbde9110e47c22f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556838:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c872b8c4/0xcbde9110e47c22f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556848:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c872b8c4/0xcbde9110e47c22f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556856:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c872b8c4/0xcbde9110e47c22f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.556868:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.556870:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.556871:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.562404:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788726179.562886:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.562899:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e5ff5d/0xcbde9110e47c22fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.562919:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.562925:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.562933:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062e5ff5d/0xcbde9110e47c22fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.562949:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062e5ff5d/0xcbde9110e47c22fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726179.562959:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.562961:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e5ff5d/0xcbde9110e47c22fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.562970:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000182c38b/0xcbde9110e47c2305 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.562973:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062e5ff5d/0xcbde9110e47c22fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.562993:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.562998:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.563003:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000182c38b/0xcbde9110e47c2305 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.563015:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000182c38b/0xcbde9110e47c2305 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.563018:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788726179.563027:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000182c38b/0xcbde9110e47c2305 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.563033:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000182c38b/0xcbde9110e47c2305 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.563159:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788726179.563415:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788726179.563423:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062e5ff5d/0xcbde9110e47c22fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.563444:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915c00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.563450:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e5ff5d/0xcbde9110e47c22fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.563461:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e5ff5d/0xcbde9110e47c22fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.563485:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062e5ff5d/0xcbde9110e47c22fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.563498:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062e5ff5d/0xcbde9110e47c22fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.563519:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726179.563523:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000182c38b/0xcbde9110e47c2305 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.563530:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e725c00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.563533:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000182c38b/0xcbde9110e47c2305 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.563541:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000182c38b/0xcbde9110e47c2305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.563553:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000182c38b/0xcbde9110e47c2305 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.563560:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000182c38b/0xcbde9110e47c2305 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.563573:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.563575:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.563576:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.564670:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788726179.565591:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.565603:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c230c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.565618:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.565622:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.565628:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c230c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.565640:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c230c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.565650:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c230c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.565658:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c230c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.565677:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788726179.565686:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726179.565692:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c230c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.565699:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031600 already unused, calling callback (ffffffffc142a230) 00010000:00010000:0.0:1788726179.565709:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c230c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.565719:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c230c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.565732:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c230c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.565739:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c230c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.565756:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726179.565757:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726179.565759:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788726179.566279:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.566285:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c2313 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.566293:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.566295:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.566299:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c2313 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.566308:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c2313 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.566316:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c2313 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.566328:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c2313 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.566343:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788726179.566352:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726179.566356:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c2313 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.566363:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:0.0:1788726179.566366:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c2313 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.566373:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c2313 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.566385:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c2313 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.566391:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c2313 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.566403:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726179.566405:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726179.566406:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788726179.570412:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.570424:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c231a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.570450:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.570455:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.570461:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c231a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.570475:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c231a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.570485:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c231a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.570493:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c231a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.570551:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788726179.571174:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.571181:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074ee1108/0xcbde9110e47c2321 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.571191:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.571195:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.571200:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074ee1108/0xcbde9110e47c2321 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.571209:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074ee1108/0xcbde9110e47c2321 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.571260:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074ee1108/0xcbde9110e47c2321 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.571268:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074ee1108/0xcbde9110e47c2321 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726179.571467:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.573113:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd64375/0xcbde9110e47c2328 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.573136:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.573141:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.573147:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd64375/0xcbde9110e47c2328 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.573163:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acd64375/0xcbde9110e47c2328 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.573175:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd64375/0xcbde9110e47c2328 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.573183:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acd64375/0xcbde9110e47c2328 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788726179.573819:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788726179.573836:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788726179.575850:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788726179.575879:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c231a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.575908:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.575914:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c231a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.575925:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c231a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.575947:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c231a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.575955:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005656a360/0xcbde9110e47c231a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.576041:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788726179.576046:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074ee1108/0xcbde9110e47c2321 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.576053:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914800 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.576057:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074ee1108/0xcbde9110e47c2321 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.576064:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074ee1108/0xcbde9110e47c2321 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.576074:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074ee1108/0xcbde9110e47c2321 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.576088:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726179.576093:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acd64375/0xcbde9110e47c2328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.576099:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030c00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.576102:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd64375/0xcbde9110e47c2328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.576108:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd64375/0xcbde9110e47c2328 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.576117:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acd64375/0xcbde9110e47c2328 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.576124:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.576126:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.576127:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726179.579480:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788726179.579497:0:15759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074ee1108/0xcbde9110e47c2321 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726179.580184:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.580193:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c232f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.580209:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788726179.580372:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726179.580399:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.580408:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c232f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.580424:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c232f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.580436:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c232f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.580455:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c232f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.580507:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788726179.580887:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.580893:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007b43338/0xcbde9110e47c2336 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.580903:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.580906:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.580911:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007b43338/0xcbde9110e47c2336 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.580920:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007b43338/0xcbde9110e47c2336 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.580927:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007b43338/0xcbde9110e47c2336 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.580934:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007b43338/0xcbde9110e47c2336 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.580957:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788726179.581718:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.581726:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075dc9e7a/0xcbde9110e47c233d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.581747:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.581749:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.581754:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075dc9e7a/0xcbde9110e47c233d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.581764:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075dc9e7a/0xcbde9110e47c233d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.581772:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075dc9e7a/0xcbde9110e47c233d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.581780:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075dc9e7a/0xcbde9110e47c233d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.581789:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788726179.582194:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.582200:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acdbf041/0xcbde9110e47c2344 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.582208:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.582211:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.582246:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acdbf041/0xcbde9110e47c2344 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.582332:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acdbf041/0xcbde9110e47c2344 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.582352:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acdbf041/0xcbde9110e47c2344 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.582360:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acdbf041/0xcbde9110e47c2344 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.582371:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788726179.582785:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.582791:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001332c861/0xcbde9110e47c234b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.582799:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.582802:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.582807:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001332c861/0xcbde9110e47c234b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.582815:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001332c861/0xcbde9110e47c234b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.582823:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001332c861/0xcbde9110e47c234b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.582829:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001332c861/0xcbde9110e47c234b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.582850:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788726179.583296:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788726179.583305:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c232f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583313:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914200 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.583318:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c232f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583338:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c232f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583355:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c232f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583364:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008974e10e/0xcbde9110e47c232f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583393:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788726179.583398:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007b43338/0xcbde9110e47c2336 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583405:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915200 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.583408:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007b43338/0xcbde9110e47c2336 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583415:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007b43338/0xcbde9110e47c2336 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583425:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007b43338/0xcbde9110e47c2336 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583431:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007b43338/0xcbde9110e47c2336 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583455:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788726179.583458:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075dc9e7a/0xcbde9110e47c233d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583464:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915800 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.583467:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075dc9e7a/0xcbde9110e47c233d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583474:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075dc9e7a/0xcbde9110e47c233d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583484:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075dc9e7a/0xcbde9110e47c233d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583490:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075dc9e7a/0xcbde9110e47c233d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583501:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788726179.583504:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acdbf041/0xcbde9110e47c2344 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583510:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914a00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.583512:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acdbf041/0xcbde9110e47c2344 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583529:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acdbf041/0xcbde9110e47c2344 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583540:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acdbf041/0xcbde9110e47c2344 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583547:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acdbf041/0xcbde9110e47c2344 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583559:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726179.583562:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001332c861/0xcbde9110e47c234b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583568:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a914600 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.583571:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001332c861/0xcbde9110e47c234b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583578:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001332c861/0xcbde9110e47c234b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583587:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001332c861/0xcbde9110e47c234b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583593:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001332c861/0xcbde9110e47c234b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.583616:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.583618:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.583619:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.583625:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.583626:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.583628:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.584183:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726179.584203:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788726179.584242:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acd64375/0xcbde9110e47c2328 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726179.585342:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.585353:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c2352 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.585366:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.585372:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.585384:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c2352 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726179.585390:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.585398:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010a4b78a/0xcbde9110e47c2359 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.585400:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c2352 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.585419:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.585424:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.585424:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c2352 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.585434:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010a4b78a/0xcbde9110e47c2359 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.585446:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010a4b78a/0xcbde9110e47c2359 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.585454:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010a4b78a/0xcbde9110e47c2359 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.585461:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010a4b78a/0xcbde9110e47c2359 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.585487:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726179.585601:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726179.585610:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010a4b78a/0xcbde9110e47c2359 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.585620:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149a400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.585625:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010a4b78a/0xcbde9110e47c2359 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.585635:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010a4b78a/0xcbde9110e47c2359 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.585669:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010a4b78a/0xcbde9110e47c2359 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.585677:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010a4b78a/0xcbde9110e47c2359 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.585699:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.585702:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.585705:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726179.585739:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c2352 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.585787:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788726179.586014:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.586021:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b3fa6c2/0xcbde9110e47c2360 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.586029:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.586039:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.586045:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b3fa6c2/0xcbde9110e47c2360 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.586055:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b3fa6c2/0xcbde9110e47c2360 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.586064:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b3fa6c2/0xcbde9110e47c2360 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.586071:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b3fa6c2/0xcbde9110e47c2360 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726179.586358:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.586365:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b538f65/0xcbde9110e47c2367 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.586374:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.586377:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.586381:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b538f65/0xcbde9110e47c2367 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.586390:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b538f65/0xcbde9110e47c2367 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.586398:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b538f65/0xcbde9110e47c2367 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.586416:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b538f65/0xcbde9110e47c2367 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.586858:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788726179.586866:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c2352 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.586874:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031600 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.586879:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c2352 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.586887:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c2352 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.586901:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c2352 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.586907:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc3ef69a/0xcbde9110e47c2352 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.586938:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788726179.586941:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b3fa6c2/0xcbde9110e47c2360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.586948:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149bc00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.586951:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b3fa6c2/0xcbde9110e47c2360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.586959:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b3fa6c2/0xcbde9110e47c2360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.586970:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b3fa6c2/0xcbde9110e47c2360 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.586979:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726179.586982:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b538f65/0xcbde9110e47c2367 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.586989:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031e00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.586992:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b538f65/0xcbde9110e47c2367 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.587000:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b538f65/0xcbde9110e47c2367 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.587023:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b538f65/0xcbde9110e47c2367 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.587030:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.587032:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.587034:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726179.587156:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788726179.587162:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b538f65/0xcbde9110e47c2367 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.587166:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788726179.587175:0:15759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b3fa6c2/0xcbde9110e47c2360 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.587262:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.587268:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788726179.587865:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.587873:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efe47fb1/0xcbde9110e47c236e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.587883:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.587887:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.587892:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efe47fb1/0xcbde9110e47c236e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.587902:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efe47fb1/0xcbde9110e47c236e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.587918:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efe47fb1/0xcbde9110e47c236e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.587925:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efe47fb1/0xcbde9110e47c236e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.587950:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788726179.587961:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.587969:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007699bc0d/0xcbde9110e47c2375 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.587979:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.587982:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.587987:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007699bc0d/0xcbde9110e47c2375 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.587998:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007699bc0d/0xcbde9110e47c2375 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.588006:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007699bc0d/0xcbde9110e47c2375 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.588015:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007699bc0d/0xcbde9110e47c2375 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.588041:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788726179.588145:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788726179.588152:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efe47fb1/0xcbde9110e47c236e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.588161:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149aa00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.588165:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efe47fb1/0xcbde9110e47c236e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.588175:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efe47fb1/0xcbde9110e47c236e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.588190:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efe47fb1/0xcbde9110e47c236e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.588197:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efe47fb1/0xcbde9110e47c236e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.588252:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726179.588262:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007699bc0d/0xcbde9110e47c2375 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.588269:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030e00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.588272:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007699bc0d/0xcbde9110e47c2375 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.588279:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007699bc0d/0xcbde9110e47c2375 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.588290:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007699bc0d/0xcbde9110e47c2375 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.588297:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007699bc0d/0xcbde9110e47c2375 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.588311:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.588313:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.588315:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.588321:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788726179.590061:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.590076:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000979ae525/0xcbde9110e47c237c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.590090:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.590095:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.590101:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000979ae525/0xcbde9110e47c237c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.590112:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000979ae525/0xcbde9110e47c237c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.590122:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000979ae525/0xcbde9110e47c237c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.590128:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000979ae525/0xcbde9110e47c237c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.590164:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788726179.590915:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.590924:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c2383 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.590936:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.590939:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.590944:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c2383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.590956:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c2383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.590965:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c2383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.590973:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c2383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.590992:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788726179.591649:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.591657:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d4fec00/0xcbde9110e47c238a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.591666:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.591670:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.591675:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d4fec00/0xcbde9110e47c238a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.591685:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d4fec00/0xcbde9110e47c238a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.591693:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d4fec00/0xcbde9110e47c238a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.591700:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d4fec00/0xcbde9110e47c238a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.591707:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788726179.592057:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.592063:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e87ebce1/0xcbde9110e47c2391 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.592071:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.592079:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.592083:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e87ebce1/0xcbde9110e47c2391 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.592092:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e87ebce1/0xcbde9110e47c2391 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.592100:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e87ebce1/0xcbde9110e47c2391 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.592107:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e87ebce1/0xcbde9110e47c2391 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.592115:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788726179.592700:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.592707:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af63e37b/0xcbde9110e47c2398 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.592714:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.592717:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.592721:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af63e37b/0xcbde9110e47c2398 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.592730:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af63e37b/0xcbde9110e47c2398 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.592738:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af63e37b/0xcbde9110e47c2398 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.592750:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af63e37b/0xcbde9110e47c2398 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.592757:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788726179.593141:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.593147:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b263c765/0xcbde9110e47c239f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.593155:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.593158:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.593161:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b263c765/0xcbde9110e47c239f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.593170:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b263c765/0xcbde9110e47c239f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.593177:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b263c765/0xcbde9110e47c239f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.593183:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b263c765/0xcbde9110e47c239f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.593190:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788726179.593306:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788726179.593315:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000979ae525/0xcbde9110e47c237c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593322:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149a200 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.593326:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000979ae525/0xcbde9110e47c237c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593333:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000979ae525/0xcbde9110e47c237c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593349:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000979ae525/0xcbde9110e47c237c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593357:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000979ae525/0xcbde9110e47c237c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593376:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788726179.593381:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c2383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593393:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031000 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.593396:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c2383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593403:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c2383 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593413:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c2383 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593418:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b793c85f/0xcbde9110e47c2383 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593434:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788726179.593437:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d4fec00/0xcbde9110e47c238a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593443:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149b200 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.593445:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d4fec00/0xcbde9110e47c238a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593451:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d4fec00/0xcbde9110e47c238a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593459:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d4fec00/0xcbde9110e47c238a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593472:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d4fec00/0xcbde9110e47c238a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593483:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788726179.593486:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e87ebce1/0xcbde9110e47c2391 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593491:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149a800 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.593494:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e87ebce1/0xcbde9110e47c2391 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593499:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e87ebce1/0xcbde9110e47c2391 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593508:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e87ebce1/0xcbde9110e47c2391 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593515:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e87ebce1/0xcbde9110e47c2391 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593525:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788726179.593528:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af63e37b/0xcbde9110e47c2398 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593534:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149ac00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.593542:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af63e37b/0xcbde9110e47c2398 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593550:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af63e37b/0xcbde9110e47c2398 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593560:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af63e37b/0xcbde9110e47c2398 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593566:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af63e37b/0xcbde9110e47c2398 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593580:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726179.593583:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b263c765/0xcbde9110e47c239f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593588:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149ae00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.593591:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b263c765/0xcbde9110e47c239f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593597:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b263c765/0xcbde9110e47c239f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593605:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b263c765/0xcbde9110e47c239f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593612:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b263c765/0xcbde9110e47c239f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.593630:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.593632:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.593634:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.593643:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788726179.594130:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.594136:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a278957/0xcbde9110e47c23a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.594150:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.594153:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.594157:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a278957/0xcbde9110e47c23a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.594167:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a278957/0xcbde9110e47c23a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.594174:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a278957/0xcbde9110e47c23a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.594181:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a278957/0xcbde9110e47c23a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.594352:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788726179.594758:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.594764:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004fccd28/0xcbde9110e47c23ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.594773:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.594776:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.594779:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004fccd28/0xcbde9110e47c23ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.594787:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004fccd28/0xcbde9110e47c23ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.594804:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004fccd28/0xcbde9110e47c23ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.594811:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004fccd28/0xcbde9110e47c23ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726179.597156:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.597170:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000321331d3/0xcbde9110e47c23b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.597187:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.597199:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.597206:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000321331d3/0xcbde9110e47c23b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.597256:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000321331d3/0xcbde9110e47c23b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.597268:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000321331d3/0xcbde9110e47c23b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.597276:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000321331d3/0xcbde9110e47c23b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.599698:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788726179.599713:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a278957/0xcbde9110e47c23a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.599727:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10149ba00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.599733:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a278957/0xcbde9110e47c23a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.599744:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a278957/0xcbde9110e47c23a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.599765:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a278957/0xcbde9110e47c23a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.599773:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a278957/0xcbde9110e47c23a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.599799:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788726179.599803:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004fccd28/0xcbde9110e47c23ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.599811:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d6e00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.599822:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004fccd28/0xcbde9110e47c23ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.599830:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004fccd28/0xcbde9110e47c23ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.599841:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004fccd28/0xcbde9110e47c23ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.599850:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726179.599855:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000321331d3/0xcbde9110e47c23b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.599862:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031a00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.599866:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000321331d3/0xcbde9110e47c23b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.599874:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000321331d3/0xcbde9110e47c23b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.599885:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000321331d3/0xcbde9110e47c23b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.599893:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.599895:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.599898:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726179.601545:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788726179.601559:0:15759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004fccd28/0xcbde9110e47c23ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726179.602198:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.602206:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c46c128c/0xcbde9110e47c23bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.602322:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.602328:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.602335:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c46c128c/0xcbde9110e47c23bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.602350:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c46c128c/0xcbde9110e47c23bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.602360:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c46c128c/0xcbde9110e47c23bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.602379:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c46c128c/0xcbde9110e47c23bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.602396:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788726179.602728:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788726179.602737:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000321331d3/0xcbde9110e47c23b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726179.602762:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.602768:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ad29431/0xcbde9110e47c23c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.602777:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.602780:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.602784:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ad29431/0xcbde9110e47c23c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.602793:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ad29431/0xcbde9110e47c23c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.602802:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ad29431/0xcbde9110e47c23c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.602809:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ad29431/0xcbde9110e47c23c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.602818:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788726179.603376:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788726179.603392:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c46c128c/0xcbde9110e47c23bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.603401:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d6400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.603406:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c46c128c/0xcbde9110e47c23bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.603415:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c46c128c/0xcbde9110e47c23bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.603433:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c46c128c/0xcbde9110e47c23bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.603441:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c46c128c/0xcbde9110e47c23bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.603455:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726179.603457:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ad29431/0xcbde9110e47c23c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.603462:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d6600 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.603463:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ad29431/0xcbde9110e47c23c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.603468:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ad29431/0xcbde9110e47c23c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.603482:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ad29431/0xcbde9110e47c23c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.603487:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ad29431/0xcbde9110e47c23c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.603493:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.603494:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.603495:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.603502:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788726179.603599:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.603605:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a79af1c1/0xcbde9110e47c23c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.603619:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.603622:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.603626:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a79af1c1/0xcbde9110e47c23c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.603637:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a79af1c1/0xcbde9110e47c23c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.603644:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a79af1c1/0xcbde9110e47c23c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.603651:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a79af1c1/0xcbde9110e47c23c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.603707:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788726179.604146:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.604153:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2cd346e/0xcbde9110e47c23d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.604161:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.604164:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.604168:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2cd346e/0xcbde9110e47c23d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.604176:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2cd346e/0xcbde9110e47c23d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.604194:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2cd346e/0xcbde9110e47c23d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.604200:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2cd346e/0xcbde9110e47c23d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726179.604353:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.604361:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf4377a/0xcbde9110e47c23d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.604371:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.604374:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.604378:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf4377a/0xcbde9110e47c23d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.604389:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf4377a/0xcbde9110e47c23d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.604404:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf4377a/0xcbde9110e47c23d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.604479:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788726179.604486:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a79af1c1/0xcbde9110e47c23c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.604494:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d7e00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.604498:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a79af1c1/0xcbde9110e47c23c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.604506:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a79af1c1/0xcbde9110e47c23c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.604517:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a79af1c1/0xcbde9110e47c23c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.604523:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a79af1c1/0xcbde9110e47c23c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.604549:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726179.604552:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2cd346e/0xcbde9110e47c23d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.604559:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d7600 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.604562:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2cd346e/0xcbde9110e47c23d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.604569:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2cd346e/0xcbde9110e47c23d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.604579:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2cd346e/0xcbde9110e47c23d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.604587:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.604589:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.604590:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726179.604610:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf4377a/0xcbde9110e47c23d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.604636:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788726179.604782:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726179.604788:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf4377a/0xcbde9110e47c23d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.604795:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031800 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.604798:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf4377a/0xcbde9110e47c23d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.604819:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf4377a/0xcbde9110e47c23d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.604831:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf4377a/0xcbde9110e47c23d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.604839:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf4377a/0xcbde9110e47c23d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.604856:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.604859:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.604862:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726179.605201:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788726179.605209:0:15759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2cd346e/0xcbde9110e47c23d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726179.605698:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.605705:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095bdc76b/0xcbde9110e47c23de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.605714:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.605718:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.605723:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095bdc76b/0xcbde9110e47c23de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.605733:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095bdc76b/0xcbde9110e47c23de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.605741:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095bdc76b/0xcbde9110e47c23de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.605760:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095bdc76b/0xcbde9110e47c23de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.605771:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788726179.606135:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.606141:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000476c5877/0xcbde9110e47c23e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.606149:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.606152:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.606156:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000476c5877/0xcbde9110e47c23e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.606164:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000476c5877/0xcbde9110e47c23e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.606172:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000476c5877/0xcbde9110e47c23e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.606179:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000476c5877/0xcbde9110e47c23e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.606187:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788726179.606597:0:15759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.606603:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000851f0df4/0xcbde9110e47c23ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.606618:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.606621:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.606625:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000851f0df4/0xcbde9110e47c23ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.606633:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000851f0df4/0xcbde9110e47c23ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.606640:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000851f0df4/0xcbde9110e47c23ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.606647:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000851f0df4/0xcbde9110e47c23ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.606654:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:3.0:1788726179.606806:0:15759:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1788726179.606904:0:15759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14338:x1875614935125632:12345-0@lo:5:osp-pre-1-0.0 Request processed in 94530us (95054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726179.606914:0:15759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788726179.606973:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111dad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14338:1875614935125632:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788726179.606989:0:14338:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788726179.607030:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111dad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14338:1875614935125760:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788726179.607063:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726179.607103:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12affa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726179.607128:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935125760 00000100:00100000:3.0:1788726179.607133:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935125760 00000100:00100000:3.0:1788726179.607178:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788726179.607187:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14338:x1875614935125760:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1788726179.607305:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788726179.607312:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095bdc76b/0xcbde9110e47c23de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.607320:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d7400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.607325:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095bdc76b/0xcbde9110e47c23de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.607334:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095bdc76b/0xcbde9110e47c23de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.607351:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095bdc76b/0xcbde9110e47c23de lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.607371:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095bdc76b/0xcbde9110e47c23de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.607391:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788726179.607395:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000476c5877/0xcbde9110e47c23e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.607401:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d7000 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.607404:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000476c5877/0xcbde9110e47c23e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.607412:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000476c5877/0xcbde9110e47c23e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.607422:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000476c5877/0xcbde9110e47c23e5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.607428:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000476c5877/0xcbde9110e47c23e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.607438:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726179.607440:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000851f0df4/0xcbde9110e47c23ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.607446:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d6200 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.607455:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000851f0df4/0xcbde9110e47c23ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.607461:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000851f0df4/0xcbde9110e47c23ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.607471:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000851f0df4/0xcbde9110e47c23ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.607477:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000851f0df4/0xcbde9110e47c23ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.607489:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.607490:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.607492:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.607499:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788726179.608067:0:14995:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00002000:00010000:0.0:1788726179.608272:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.608280:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6138ba1/0xcbde9110e47c23f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.608293:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.608297:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.608303:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6138ba1/0xcbde9110e47c23f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.608316:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6138ba1/0xcbde9110e47c23f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.608325:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6138ba1/0xcbde9110e47c23f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.608334:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6138ba1/0xcbde9110e47c23f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.608365:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788726179.609426:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726179.609434:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6138ba1/0xcbde9110e47c23f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.609444:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:1.0:1788726179.609448:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6138ba1/0xcbde9110e47c23f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.609459:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6138ba1/0xcbde9110e47c23f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.609474:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6138ba1/0xcbde9110e47c23f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.609486:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6138ba1/0xcbde9110e47c23f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726179.609503:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.609504:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726179.609506:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788726179.610119:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.610128:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c23fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.610139:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.610143:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.610149:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c23fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.610160:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c23fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.610169:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c23fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.610177:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c23fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.610203:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726179.610719:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726179.610727:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c23fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.610736:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.610740:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c23fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.610763:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c23fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.610777:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c23fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.610785:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014043421/0xcbde9110e47c23fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.610801:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.610803:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.610805:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788726179.611385:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.611392:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b218a5b7/0xcbde9110e47c2401 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.611401:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.611579:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.611586:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b218a5b7/0xcbde9110e47c2401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.611599:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b218a5b7/0xcbde9110e47c2401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.611607:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b218a5b7/0xcbde9110e47c2401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.611615:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b218a5b7/0xcbde9110e47c2401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.611670:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788726179.612354:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.612362:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c2408 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.612372:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.612376:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.612380:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c2408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.612391:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c2408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.612400:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c2408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.612429:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c2408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.612790:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788726179.612798:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b218a5b7/0xcbde9110e47c2401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.612808:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030200 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.612813:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b218a5b7/0xcbde9110e47c2401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.612823:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b218a5b7/0xcbde9110e47c2401 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.612841:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b218a5b7/0xcbde9110e47c2401 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.612860:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b218a5b7/0xcbde9110e47c2401 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.612881:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726179.612883:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c2408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.612889:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100031c00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.612893:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c2408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.612901:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c2408 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.612912:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c2408 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.612921:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.612924:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.612927:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726179.612999:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788726179.613005:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8557f58/0xcbde9110e47c2408 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.613608:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788726179.614333:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.614343:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000320fa8c6/0xcbde9110e47c240f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.614356:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.614362:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.614368:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000320fa8c6/0xcbde9110e47c240f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.614380:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000320fa8c6/0xcbde9110e47c240f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.614389:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000320fa8c6/0xcbde9110e47c240f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.614397:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000320fa8c6/0xcbde9110e47c240f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.614653:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788726179.615361:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.615369:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006754b4c3/0xcbde9110e47c2416 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.615380:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.615384:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.615389:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006754b4c3/0xcbde9110e47c2416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.615398:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006754b4c3/0xcbde9110e47c2416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.615406:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006754b4c3/0xcbde9110e47c2416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.615424:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006754b4c3/0xcbde9110e47c2416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.615656:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788726179.615663:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000320fa8c6/0xcbde9110e47c240f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.615671:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a100030a00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.615684:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000320fa8c6/0xcbde9110e47c240f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.615693:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000320fa8c6/0xcbde9110e47c240f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.615710:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000320fa8c6/0xcbde9110e47c240f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.615718:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000320fa8c6/0xcbde9110e47c240f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.615739:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726179.615743:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006754b4c3/0xcbde9110e47c2416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.615749:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a005fb6600 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.615753:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006754b4c3/0xcbde9110e47c2416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.615760:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006754b4c3/0xcbde9110e47c2416 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.615772:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006754b4c3/0xcbde9110e47c2416 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.615781:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.615789:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.615792:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726179.615885:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788726179.615890:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006754b4c3/0xcbde9110e47c2416 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726179.616031:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14338:x1875614935125760:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8840us (8962us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788726179.616043:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788726179.616588:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788726179.616660:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.616667:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cfb82c6/0xcbde9110e47c241d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.616685:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.616689:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.616695:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cfb82c6/0xcbde9110e47c241d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.616706:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cfb82c6/0xcbde9110e47c241d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.616716:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cfb82c6/0xcbde9110e47c241d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.616724:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cfb82c6/0xcbde9110e47c241d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.616779:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788726179.617269:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.617275:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006624e3e1/0xcbde9110e47c2424 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.617284:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.617288:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.617292:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006624e3e1/0xcbde9110e47c2424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.617302:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006624e3e1/0xcbde9110e47c2424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.617323:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006624e3e1/0xcbde9110e47c2424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.617330:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006624e3e1/0xcbde9110e47c2424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.617388:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788726179.617394:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cfb82c6/0xcbde9110e47c241d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.617401:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a005fb7e00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.617406:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cfb82c6/0xcbde9110e47c241d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.617425:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cfb82c6/0xcbde9110e47c241d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.617445:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cfb82c6/0xcbde9110e47c241d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.617453:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cfb82c6/0xcbde9110e47c241d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.617469:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726179.617471:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006624e3e1/0xcbde9110e47c2424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.617477:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a005fb7600 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.617489:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006624e3e1/0xcbde9110e47c2424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.617508:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006624e3e1/0xcbde9110e47c2424 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.617518:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006624e3e1/0xcbde9110e47c2424 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.617525:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.617527:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.617528:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726179.617753:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788726179.617758:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006624e3e1/0xcbde9110e47c2424 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726179.618199:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.618205:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000992da102/0xcbde9110e47c242b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.618245:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.618249:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.618254:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000992da102/0xcbde9110e47c242b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.618263:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000992da102/0xcbde9110e47c242b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.618272:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000992da102/0xcbde9110e47c242b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.618292:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000992da102/0xcbde9110e47c242b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.618697:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726179.618703:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000992da102/0xcbde9110e47c242b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.618712:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a005fb7400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.618716:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000992da102/0xcbde9110e47c242b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.618724:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000992da102/0xcbde9110e47c242b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.618740:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000992da102/0xcbde9110e47c242b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.618747:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.618749:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.618751:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726179.618825:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788726179.618830:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000992da102/0xcbde9110e47c242b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726179.619403:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788726179.619418:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c4e7b57/0xcbde9110e47c2432 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.619428:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788726179.619439:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726179.619444:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c4e7b57/0xcbde9110e47c2432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.619455:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c4e7b57/0xcbde9110e47c2432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.619463:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c4e7b57/0xcbde9110e47c2432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726179.619471:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c4e7b57/0xcbde9110e47c2432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726179.619750:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111dad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14338:1875614935125760:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788726179.619768:0:14338:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1788726179.619893:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726179.619899:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c4e7b57/0xcbde9110e47c2432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.619908:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a005fb7000 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.619913:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c4e7b57/0xcbde9110e47c2432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.619921:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c4e7b57/0xcbde9110e47c2432 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.619933:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c4e7b57/0xcbde9110e47c2432 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.619942:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.619943:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.619945:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726179.619990:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788726179.619996:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c4e7b57/0xcbde9110e47c2432 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.620607:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788726179.620978:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788726179.620986:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000210155/0xcbde9110e47c2439 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.620998:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788726179.621002:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726179.621007:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000210155/0xcbde9110e47c2439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.621020:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000210155/0xcbde9110e47c2439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.621028:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000210155/0xcbde9110e47c2439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.621036:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000210155/0xcbde9110e47c2439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726179.621055:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726179.621081:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726179.621088:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000210155/0xcbde9110e47c2439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.621097:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d7800 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726179.621102:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000210155/0xcbde9110e47c2439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.621111:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000210155/0xcbde9110e47c2439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.621140:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000210155/0xcbde9110e47c2439 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.621148:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000210155/0xcbde9110e47c2439 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726179.621168:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.621170:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726179.621172:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788726179.622611:0:14996:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1788726179.622728:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14336:x1875614935125376:12345-0@lo:5:osp-pre-0-0.0 Request processed in 112625us (112879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726179.622739:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788726179.623771:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c48380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14336:1875614935125376:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788726179.623789:0:14336:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788726179.623836:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14336:1875614935125888:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788726179.623886:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726179.623930:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13a947a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788726179.623976:0:15759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935125888 00000100:00100000:3.0:1788726179.623982:0:15759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935125888 00000100:00100000:3.0:1788726179.624031:0:15759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788726179.624040:0:15759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14336:x1875614935125888:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788726179.624084:0:15759:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788726179.634023:0:15759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14336:x1875614935125888:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9978us (10130us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788726179.634037:0:15759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788726179.634186:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14336:1875614935125888:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788726179.634200:0:14336:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1788726179.798458:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788726180.250597:0:14310:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788726180.250605:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91a13ad4c800 from 8 10000000:01000000:2.0:1788726180.250610:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788726180.250659:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a1398ea600/0xcbde9110e47c2440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726180.250673:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a1398ea600/0xcbde9110e47c2440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726180.250685:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a1398ea600/0xcbde9110e47c2440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726180.250713:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935126016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788726180.250784:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726180.250849:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a102a913c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726180.251114:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935126016 00000100:00100000:0.0:1788726180.251123:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935126016 00000100:00100000:0.0:1788726180.251179:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788726180.251198:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:14310:x1875614935126016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788726180.251238:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726180.251254:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a005fb7400/0xcbde9110e47c2447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c2440 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726180.251276:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a005fb7400/0xcbde9110e47c2447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c2440 expref: 19 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726180.251286:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a005fb7400/0xcbde9110e47c2447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c2440 expref: 19 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726180.251295:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a005fb7400, rc 0) 00000100:00100000:0.0:1788726180.251334:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:14310:x1875614935126016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726180.251341:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788726180.251451:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935126016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726180.251465:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a1398ea600/0xcbde9110e47c2440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2447 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726180.251491:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a1398ea600/0xcbde9110e47c2440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c2447 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726180.251541:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935126144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788726180.251568:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726180.251595:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a102a913c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726180.252512:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935126144 00000100:00100000:0.0:1788726180.252523:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935126144 00000100:00100000:0.0:1788726180.252557:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788726180.252565:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:14310:x1875614935126144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788726180.252594:0:14305:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788726180.252609:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788726180.252613:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788726180.252707:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:14310:x1875614935126144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726180.252715:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788726180.254455:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935126144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788726180.254526:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788726180.254537:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a1398ea600/0xcbde9110e47c2440 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2447 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726180.254547:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a1398ea600/0xcbde9110e47c2440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2447 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726180.822105:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788726181.696447:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1788726181.696462:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788726181.846526:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726182.874352:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788726183.738181:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788726183.738277:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788726183.896514:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726184.661419:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935126272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788726184.661486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726184.661553:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935126272 00000100:00100000:1.0:1788726184.661560:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935126272 00000100:00100000:1.0:1788726184.661617:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788726184.661635:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935126272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788726184.661668:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788726184.661708:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935126272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726184.661714:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788726184.661732:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788726184.661760:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788726184.661780:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935126272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788726184.662057:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935126400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788726184.662083:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726184.662104:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935126912:0@lo:400:kworker.0 00000100:00100000:1.0:1788726184.662125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726184.662156:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788726184.662162:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935126528:0@lo:400:kworker.0 00000100:00100000:1.0:1788726184.662187:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726184.662206:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935127040:0@lo:400:kworker.0 00000100:00100000:1.0:1788726184.662253:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726184.662280:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935126912 00000100:00100000:1.0:1788726184.662285:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935126912 00000100:00100000:1.0:1788726184.662314:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935127040 00000100:00100000:1.0:1788726184.662317:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935127040 00000100:00100000:1.0:1788726184.662336:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788726184.662343:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935126912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726184.662379:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935126912:12345-0@lo:400:kworker.0 Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726184.662385:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788726184.662405:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788726184.662411:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935127040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726184.662438:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935127040:12345-0@lo:400:kworker.0 Request processed in 27us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726184.662443:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788726184.662461:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935126528 00000100:00100000:1.0:1788726184.662464:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935126528 00000100:00100000:1.0:1788726184.662487:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788726184.662493:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:3306:x1875614935126528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726184.662518:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:3306:x1875614935126528:12345-0@lo:400:kworker.0 Request processed in 26us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726184.662524:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788726184.662567:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935126656:0@lo:400:kworker.0 00000100:00100000:1.0:1788726184.662591:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726184.662609:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788726184.662614:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935126784:0@lo:400:kworker.0 00000100:00100000:1.0:1788726184.662634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726184.662656:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935126656 00000100:00100000:1.0:1788726184.662659:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935126656 00000100:00100000:1.0:1788726184.662686:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788726184.662691:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935126656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726184.662720:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935126656:12345-0@lo:400:kworker.0 Request processed in 29us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726184.662726:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788726184.662740:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788726184.662744:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726184.662760:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788726184.662778:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935126656:0@lo:400:kworker.0 00000100:00100000:1.0:1788726184.662793:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935126784 00000100:00100000:1.0:1788726184.662797:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935126784 00000100:00100000:1.0:1788726184.662818:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788726184.662823:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935126784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726184.662854:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935126784:12345-0@lo:400:kworker.0 Request processed in 31us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726184.662861:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788726184.662886:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13ab49500 x1875614935126784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726184.662897:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935126784:0@lo:400:kworker.0 00000100:00100000:1.0:1788726184.662911:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935126400 00000100:00100000:1.0:1788726184.662914:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935126400 00000100:00100000:1.0:1788726184.662932:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788726184.662936:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935126400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788726184.662956:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788726184.662980:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935126400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726184.662986:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788726184.663007:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935126528:0@lo:400:kworker.0 00010000:00080000:1.0:1788726184.663016:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13ab4a680 x1875614935127040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726184.663025:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935127040:0@lo:400:kworker.0 00000100:00100000:1.0:1788726184.663036:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935126400:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788726184.663050:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91a13ab4bb80 x1875614935126912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726184.663058:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935126912:0@lo:400:kworker.0 00010000:00010000:3.0:1788726184.931297:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788726185.695714:0:16069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg142-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788726185.942454:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788726186.326292:0:14344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788726186.967923:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726187.697584:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726187.697741:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914159232 00000100:00100000:0.0:1788726187.697754:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914159232 00000100:00100000:0.0:1788726187.697872:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:0.0:1788726187.697884:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1875614914159232:12345-192.168.201.42@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788726187.697923:0:14307:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ab7e8877-a281-4332-b6fb-e13d74566ae9@192.168.201.42@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:0.0:1788726187.697967:0:14307:0:(genops.c:1385:class_connect()) connect: client ab7e8877-a281-4332-b6fb-e13d74566ae9, cookie 0xcbde9110e47c244e 00000100:00080000:0.0:1788726187.699007:0:14307:0:(import.c:65:import_set_state_nolock()) ffff91a12aedf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788726187.699568:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+5:2348:x1875614914159232:12345-192.168.201.42@tcp:250:mount.lustre.0 Request processed in 1680us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726187.699582:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 75 00000100:00100000:0.0:1788726187.719190:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726187.719537:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914159360 00000100:00100000:1.0:1788726187.719552:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914159360 00000100:00100000:1.0:1788726187.719656:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:1.0:1788726187.719677:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+5:13724:x1875614914159360:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788726187.719705:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726187.719728:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a108921c00/0xcbde9110e47c2455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be9055a383 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726187.720187:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a108921c00/0xcbde9110e47c2455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a383 expref: 6 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726187.720204:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a108921c00/0xcbde9110e47c2455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a383 expref: 6 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726187.720253:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921c00, rc 0) 00000100:00100000:1.0:1788726187.720321:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+6:13724:x1875614914159360:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 655us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726187.720329:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 76 00000100:00100000:2.0:1788726187.737186:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726187.737505:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914159488 00000100:00100000:1.0:1788726187.737521:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914159488 00000100:00100000:1.0:1788726187.737956:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:1.0:1788726187.737970:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+6:13724:x1875614914159488:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788726187.738479:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+6:13724:x1875614914159488:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 510us (1306us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788726187.738490:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 77 00000100:00100000:0.0:1788726187.754686:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726187.754815:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914159616 00000100:00100000:1.0:1788726187.754830:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914159616 00000100:00100000:1.0:1788726187.754906:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:1.0:1788726187.754920:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+6:13724:x1875614914159616:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788726187.754945:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726187.754971:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a108920200/0xcbde9110e47c245c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be9055a38a expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726187.755013:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a108920200/0xcbde9110e47c245c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a38a expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726187.755027:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a108920200/0xcbde9110e47c245c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a38a expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726187.755038:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920200, rc 0) 00000100:00100000:1.0:1788726187.755140:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+7:13724:x1875614914159616:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 224us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726187.755148:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 78 00000100:00100000:0.0:1788726187.763831:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726187.763958:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914159744 00000100:00100000:1.0:1788726187.763972:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914159744 00000100:00100000:1.0:1788726187.764139:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:1.0:1788726187.764153:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+7:13724:x1875614914159744:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788726187.764876:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+8:13724:x1875614914159744:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 721us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726187.764895:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 79 00000100:00100000:2.0:1788726187.776868:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726187.776955:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914159872 00000100:00100000:1.0:1788726187.776971:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914159872 00000100:00100000:0.0:1788726187.777145:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:0.0:1788726187.777165:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+8:13724:x1875614914159872:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788726187.777804:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+8:13724:x1875614914159872:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 540us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726187.777815:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 80 00000100:00100000:2.0:1788726187.786066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726187.787191:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914160000 00000100:00100000:1.0:1788726187.787209:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914160000 00000100:00100000:1.0:1788726187.787345:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:1.0:1788726187.787359:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+8:13742:x1875614914160000:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788726187.787846:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+8:13742:x1875614914160000:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 486us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726187.787858:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 81 00000100:00100000:2.0:1788726187.814841:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726187.815057:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914160128 00000100:00100000:0.0:1788726187.815071:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914160128 00000100:00100000:0.0:1788726187.815263:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:0.0:1788726187.815276:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13bd98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+8:13742:x1875614914160128:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788726187.816027:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13bd98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+8:13742:x1875614914160128:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 746us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726187.816041:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 82 00000100:00100000:3.0:1788726187.834844:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726187.835182:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914160256 00000100:00100000:2.0:1788726187.835206:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914160256 00000100:00100000:2.0:1788726187.835331:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:2.0:1788726187.835344:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+8:13724:x1875614914160256:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788726187.835366:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726187.835401:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c2463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be9055a3b4 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726187.835459:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c2463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a3b4 expref: 9 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726187.835472:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a1398eac00/0xcbde9110e47c2463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a3b4 expref: 9 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726187.835485:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eac00, rc 0) 00000100:00100000:2.0:1788726187.835561:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+9:13724:x1875614914160256:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 220us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726187.835569:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 83 00000100:00100000:2.0:1788726187.847919:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726187.850945:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914160384 00000100:00100000:0.0:1788726187.850968:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914160384 00000100:00100000:0.0:1788726187.851057:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 84 00000100:00100000:0.0:1788726187.851273:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+9:13724:x1875614914160384:12345-192.168.201.42@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788726187.851324:0:14305:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788726187.851365:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788726187.851371:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788726187.851439:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788726187.851443:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788726187.854920:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+9:13724:x1875614914160384:12345-192.168.201.42@tcp:256:mount.lustre.0 Request processed in 3835us (7000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726187.854940:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 84 00000100:00100000:3.0:1788726187.860890:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726187.861074:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914160512 00000100:00100000:1.0:1788726187.861098:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914160512 00000100:00100000:1.0:1788726187.861171:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:1.0:1788726187.861183:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+9:13724:x1875614914160512:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788726187.861205:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726187.861272:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a108920800/0xcbde9110e47c246a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be9055a3bb expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726187.861321:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a108920800/0xcbde9110e47c246a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a3bb expref: 10 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726187.861335:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a108920800/0xcbde9110e47c246a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a3bb expref: 10 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726187.861588:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920800, rc 0) 00000100:00100000:1.0:1788726187.861662:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+10:13724:x1875614914160512:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 480us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726187.861670:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 85 00000100:00100000:2.0:1788726187.865135:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726187.865252:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914160640 00000100:00100000:1.0:1788726187.865265:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914160640 00000100:00100000:1.0:1788726187.865349:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:1.0:1788726187.865361:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+10:13724:x1875614914160640:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788726187.865894:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+10:13724:x1875614914160640:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 532us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726187.865904:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 86 00000100:00100000:0.0:1788726187.870693:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726187.870973:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914160768 00000100:00100000:1.0:1788726187.870987:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914160768 00000100:00100000:1.0:1788726187.871123:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00100000:1.0:1788726187.871136:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+10:13724:x1875614914160768:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788726187.871780:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+10:13724:x1875614914160768:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 642us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726187.871790:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 87 00000100:00100000:3.0:1788726187.876301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726187.876601:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914160896 00000100:00100000:1.0:1788726187.876614:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914160896 00000100:00100000:1.0:1788726187.876686:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:1.0:1788726187.876697:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+10:13747:x1875614914160896:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788726187.877193:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+10:13747:x1875614914160896:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 495us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726187.877240:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 88 00000100:00100000:0.0:1788726187.889605:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726187.889814:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914161024 00000100:00100000:1.0:1788726187.889828:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914161024 00000100:00100000:1.0:1788726187.889904:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:1.0:1788726187.889916:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+10:13747:x1875614914161024:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788726187.890349:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+10:13747:x1875614914161024:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 433us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726187.890360:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 89 00000100:00100000:0.0:1788726187.907436:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726187.907769:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914161152 00000100:00100000:1.0:1788726187.907783:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914161152 00000100:00100000:1.0:1788726187.907851:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:1.0:1788726187.907862:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1875614914161152:12345-192.168.201.42@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788726187.907904:0:14313:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 459896fe-20ed-424c-974b-8a35340505e4@192.168.201.42@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:1.0:1788726187.907968:0:14313:0:(genops.c:1385:class_connect()) connect: client 459896fe-20ed-424c-974b-8a35340505e4, cookie 0xcbde9110e47c2471 00000004:00100000:1.0:1788726187.908009:0:14313:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:1.0:1788726187.908017:0:14313:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1788726187.989906:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788726187.991445:0:14313:0:(import.c:65:import_set_state_nolock()) ffff91a139881000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788726187.991533:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+6:2348:x1875614914161152:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 83670us (84113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726187.991546:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:3.0:1788726187.997108:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726187.997207:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726187.997333:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914161408 00000100:00100000:0.0:1788726187.997350:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914161408 00000100:00100000:0.0:1788726187.997441:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914161280 00000100:00100000:0.0:1788726187.997444:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914161280 00000100:00100000:0.0:1788726187.997478:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:0.0:1788726187.997513:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+7:13724:x1875614914161408:12345-192.168.201.42@tcp:41:mount.lustre.0 00000100:00100000:3.0:1788726187.997553:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:3.0:1788726187.997567:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+7:0:x1875614914161280:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788726187.997573:0:15361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000004:00000024:3.0:1788726187.997594:0:14314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1788726187.997691:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726187.997700:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+7:13724:x1875614914161408:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 188us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726187.997711:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:3.0:1788726187.997746:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+6:0:x1875614914161280:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 182us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726187.997796:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:3.0:1788726188.002582:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726188.004680:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914161536 00000100:00100000:0.0:1788726188.004699:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914161536 00000100:00100000:0.0:1788726188.004784:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:0.0:1788726188.004797:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+6:13724:x1875614914161536:12345-192.168.201.42@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788726188.004915:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+6:13724:x1875614914161536:12345-192.168.201.42@tcp:40:mount.lustre.0 Request processed in 119us (2509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726188.004923:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:0.0:1788726188.006994:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726188.007044:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726188.007127:0:15759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914161664 00000100:00100000:3.0:1788726188.007138:0:15759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914161664 00000100:00100000:3.0:1788726188.007183:0:15759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914161792 00000100:00100000:3.0:1788726188.007186:0:15759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914161792 00000100:00100000:3.0:1788726188.007256:0:15759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:3.0:1788726188.007276:0:15759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875614914161664:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788726188.007309:0:15759:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 459896fe-20ed-424c-974b-8a35340505e4@192.168.201.42@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:3.0:1788726188.007514:0:15759:0:(genops.c:1385:class_connect()) connect: client 459896fe-20ed-424c-974b-8a35340505e4, cookie 0xcbde9110e47c2478 00002000:00100000:3.0:1788726188.007526:0:15759:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 459896fe-20ed-424c-974b-8a35340505e4/ffff91a13adc4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788726188.007550:0:15759:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788726188.007867:0:15759:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788726188.007900:0:15759:0:(import.c:65:import_set_state_nolock()) ffff91a13adc3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788726188.007963:0:15759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:459896fe-20ed-424c-974b-8a35340505e4+6:2348:x1875614914161664:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 698us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726188.007971:0:15759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:3.0:1788726188.007990:0:15759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788726188.007995:0:15759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875614914161792:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788726188.008010:0:15759:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 459896fe-20ed-424c-974b-8a35340505e4@192.168.201.42@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:3.0:1788726188.008026:0:15759:0:(genops.c:1385:class_connect()) connect: client 459896fe-20ed-424c-974b-8a35340505e4, cookie 0xcbde9110e47c247f 00002000:00100000:3.0:1788726188.008031:0:15759:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 459896fe-20ed-424c-974b-8a35340505e4/ffff91a13adc7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788726188.008045:0:15759:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788726188.008748:0:15759:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788726188.008771:0:15759:0:(import.c:65:import_set_state_nolock()) ffff91a13adc3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788726188.008816:0:15759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:459896fe-20ed-424c-974b-8a35340505e4+6:2348:x1875614914161792:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 819us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726188.008841:0:15759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788726188.010878:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726188.015018:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914161920 00000100:00100000:0.0:1788726188.015035:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914161920 00000100:00100000:0.0:1788726188.015741:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:0.0:1788726188.015754:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+6:13724:x1875614914161920:12345-192.168.201.42@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788726188.018486:0:14316:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2105us 00000004:00200000:1.0:1788726188.048181:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788726188.048372:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+6:13724:x1875614914161920:12345-192.168.201.42@tcp:33:mount.lustre.0 Request processed in 32613us (37570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726188.048399:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:3.0:1788726188.275372:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726188.286748:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914162048 00000100:00100000:1.0:1788726188.286782:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914162048 00000100:00100000:1.0:1788726188.286878:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:1.0:1788726188.286891:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+6:13768:x1875614914162048:12345-192.168.201.42@tcp:101:mkdir.0 00010000:00010000:1.0:1788726188.286915:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726188.286947:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2486 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a3e5 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726188.287018:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c248d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726188.287033:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c248d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726188.287060:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c248d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726188.287108:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788726188.287112:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788726188.287155:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c248d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726188.287180:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2486 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a3e5 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726188.287197:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c248d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a3e5 expref: 7 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726188.287207:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:1.0:1788726188.287210:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788726188.287254:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921400, rc 0) 00000100:00100000:1.0:1788726188.287674:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+7:13768:x1875614914162048:12345-192.168.201.42@tcp:101:mkdir.0 Request processed in 783us (12310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726188.287682:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000001:00100000:0.0:1788726188.838380:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 459896fe-20ed-424c-974b-8a35340505e4 00010000:00010000:3.0:1788726189.013630:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726189.782098:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788726189.782130:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935127296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788726189.782251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726189.782318:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935127168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788726189.782319:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935127424:0@lo:400:kworker.0 00000100:00100000:1.0:1788726189.782344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726189.782357:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726189.782387:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935127296 00000100:00100000:1.0:1788726189.782397:0:14999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935127296 00000100:00100000:0.0:1788726189.782432:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935127168 00000100:00100000:0.0:1788726189.782437:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935127168 00000100:00100000:1.0:1788726189.782457:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788726189.782468:0:14999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935127296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788726189.782497:0:14999:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788726189.782549:0:14999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935127296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726189.784372:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788726189.784406:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935127552:0@lo:400:kworker.0 00000100:00100000:2.0:1788726189.784604:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726189.784684:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935127424 00000100:00100000:2.0:1788726189.784694:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935127424 00000100:00100000:2.0:1788726189.784753:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788726189.784764:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:3306:x1875614935127424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726189.784827:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:3306:x1875614935127424:12345-0@lo:400:kworker.0 Request processed in 64us (2468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726189.784853:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1788726189.784898:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788726189.784904:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788726189.784936:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935127424:0@lo:400:kworker.0 00000100:00100000:2.0:1788726189.785780:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935127552 00000100:00100000:2.0:1788726189.785790:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935127552 00000100:00100000:2.0:1788726189.785848:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788726189.785857:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935127552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726189.785924:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875614935127552:12345-0@lo:400:kworker.0 Request processed in 68us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726189.785931:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788726189.785971:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875614935127552:0@lo:400:kworker.0 00000100:00100000:2.0:1788726189.786036:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935127296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788726189.787354:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788726189.787373:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935127680:0@lo:400:kworker.0 00000100:00100000:3.0:1788726189.788864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726189.788924:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935127808:0@lo:400:kworker.0 00000100:00100000:3.0:1788726189.788956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726189.788994:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935127680 00000100:00100000:3.0:1788726189.789004:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935127680 00000100:00100000:3.0:1788726189.789110:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935127808 00000100:00100000:3.0:1788726189.789114:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935127808 00000100:00100000:3.0:1788726189.789144:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788726189.789154:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935127680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726189.789232:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935127680:12345-0@lo:400:kworker.0 Request processed in 64us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726189.789239:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788726189.789261:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788726189.789267:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935127808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726189.789300:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875614935127808:12345-0@lo:400:kworker.0 Request processed in 33us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726189.789305:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788726189.789327:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726189.789365:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875614935127808:0@lo:400:kworker.0 00000100:00100000:3.0:1788726189.789377:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935127680:0@lo:400:kworker.0 00000100:00100000:1.0:1788726189.795243:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788726189.795315:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788726189.795339:0:14999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935127168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788726189.795379:0:14999:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788726189.795516:0:14999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875614935127168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 191us (13170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726189.795524:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788726189.796307:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875614935127168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788726190.040238:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726190.110851:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726190.111016:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914162176 00000100:00100000:3.0:1788726190.111031:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914162176 00000100:00100000:3.0:1788726190.111154:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:3.0:1788726190.111167:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+7:13820:x1875614914162176:12345-192.168.201.42@tcp:41:lfs.0 00000004:00000024:3.0:1788726190.111735:0:14313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788726190.111868:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+7:13820:x1875614914162176:12345-192.168.201.42@tcp:41:lfs.0 Request processed in 702us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726190.111877:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00080000:2.0:1788726190.112382:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726190.118547:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726190.118718:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914162304 00000100:00100000:0.0:1788726190.118729:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914162304 00000100:00100000:0.0:1788726190.118874:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:0.0:1788726190.118887:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:459896fe-20ed-424c-974b-8a35340505e4+6:13820:x1875614914162304:12345-192.168.201.42@tcp:13:lfs.0 00002000:00000024:0.0:1788726190.118926:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726190.119033:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:459896fe-20ed-424c-974b-8a35340505e4+6:13820:x1875614914162304:12345-192.168.201.42@tcp:13:lfs.0 Request processed in 148us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726190.119042:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00080000:2.0:1788726190.120016:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788726190.124564:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726190.125835:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914162432 00000100:00100000:1.0:1788726190.125855:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914162432 00000100:00100000:1.0:1788726190.125969:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:1.0:1788726190.125985:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:459896fe-20ed-424c-974b-8a35340505e4+5:13820:x1875614914162432:12345-192.168.201.42@tcp:13:lfs.0 00000100:00080000:2.0:1788726190.126002:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1788726190.126080:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788726190.126199:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:459896fe-20ed-424c-974b-8a35340505e4+5:13820:x1875614914162432:12345-192.168.201.42@tcp:13:lfs.0 Request processed in 218us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726190.126209:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788726190.273922:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726190.274155:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914162560 00000100:00100000:0.0:1788726190.274166:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914162560 00000100:00100000:0.0:1788726190.274248:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:0.0:1788726190.274268:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+10:13852:x1875614914162560:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788726190.274285:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726190.274302:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a005fb6600/0xcbde9110e47c2494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be9055a3ec expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726190.274331:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a005fb6600/0xcbde9110e47c2494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a3ec expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726190.274343:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a005fb6600/0xcbde9110e47c2494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a3ec expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726190.274361:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a005fb6600, rc 0) 00000100:00100000:0.0:1788726190.274437:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+11:13852:x1875614914162560:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 174us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726190.274444:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 91 00000100:00100000:3.0:1788726190.290833:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726190.291135:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914162688 00000100:00100000:2.0:1788726190.291145:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914162688 00000100:00100000:2.0:1788726190.291210:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:2.0:1788726190.291279:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+11:13852:x1875614914162688:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788726190.291600:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+11:13852:x1875614914162688:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 324us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726190.291610:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 92 00000100:00100000:3.0:1788726190.296160:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726190.296439:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914162816 00000100:00100000:2.0:1788726190.296451:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914162816 00000100:00100000:2.0:1788726190.296654:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:2.0:1788726190.296667:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+11:13852:x1875614914162816:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788726190.297908:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+11:13852:x1875614914162816:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 1236us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726190.297922:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 93 00000100:00100000:3.0:1788726190.313033:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726190.313451:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914162944 00000100:00100000:0.0:1788726190.313462:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914162944 00000100:00100000:0.0:1788726190.313530:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 94 00000100:00100000:0.0:1788726190.313542:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+11:13859:x1875614914162944:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788726190.313865:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+11:13859:x1875614914162944:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 325us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726190.313879:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 94 00000100:00100000:3.0:1788726190.339740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726190.339980:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914163072 00000100:00100000:2.0:1788726190.339990:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914163072 00000100:00100000:2.0:1788726190.340059:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 95 00000100:00100000:2.0:1788726190.340070:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+11:13859:x1875614914163072:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788726190.340395:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+11:13859:x1875614914163072:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 326us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726190.340403:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 95 00000100:00100000:3.0:1788726190.345425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726190.347084:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914163200 00000100:00100000:1.0:1788726190.347100:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914163200 00000100:00100000:1.0:1788726190.347169:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00100000:1.0:1788726190.347182:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+11:13852:x1875614914163200:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788726190.347199:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726190.347239:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a108920600/0xcbde9110e47c249b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be9055a416 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726190.347269:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a108920600/0xcbde9110e47c249b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a416 expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726190.347280:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a108920600/0xcbde9110e47c249b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a416 expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726190.347289:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920600, rc 0) 00000100:00100000:1.0:1788726190.347363:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+12:13852:x1875614914163200:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 183us (1948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726190.347371:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 96 00000100:00100000:1.0:1788726190.353019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726190.353134:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914163328 00000100:00100000:0.0:1788726190.353145:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914163328 00000100:00100000:0.0:1788726190.353201:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00100000:0.0:1788726190.353253:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13399dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+12:13852:x1875614914163328:12345-192.168.201.42@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788726190.353285:0:14305:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788726190.354406:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788726190.354414:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788726190.354417:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788726190.354420:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788726190.358475:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13399dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+12:13852:x1875614914163328:12345-192.168.201.42@tcp:256:mount.lustre.0 Request processed in 4994us (5194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726190.358493:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 97 00000100:00100000:3.0:1788726190.364275:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726190.364527:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914163456 00000100:00100000:2.0:1788726190.364536:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914163456 00000100:00100000:2.0:1788726190.364593:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:2.0:1788726190.364603:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+12:13852:x1875614914163456:12345-192.168.201.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788726190.364619:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726190.364643:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a1398eaa00/0xcbde9110e47c24a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be9055a41d expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726190.364671:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398eaa00/0xcbde9110e47c24a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a41d expref: 13 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726190.364681:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a1398eaa00/0xcbde9110e47c24a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a41d expref: 13 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726190.364708:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eaa00, rc 0) 00000100:00100000:2.0:1788726190.365186:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:13852:x1875614914163456:12345-192.168.201.42@tcp:101:mount.lustre.0 Request processed in 583us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726190.365193:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 98 00000100:00100000:1.0:1788726190.368154:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726190.368373:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914163584 00000100:00100000:0.0:1788726190.368385:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914163584 00000100:00100000:0.0:1788726190.368441:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 99 00000100:00100000:0.0:1788726190.368452:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:13852:x1875614914163584:12345-192.168.201.42@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788726190.369550:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:13852:x1875614914163584:12345-192.168.201.42@tcp:501:mount.lustre.0 Request processed in 1094us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726190.369561:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 99 00000100:00100000:3.0:1788726190.374537:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726190.374740:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914163712 00000100:00100000:2.0:1788726190.374752:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914163712 00000100:00100000:2.0:1788726190.374825:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:2.0:1788726190.374835:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:13852:x1875614914163712:12345-192.168.201.42@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788726190.375140:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:13852:x1875614914163712:12345-192.168.201.42@tcp:503:mount.lustre.0 Request processed in 305us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726190.375149:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 100 00000100:00100000:3.0:1788726190.383209:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726190.383537:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914163840 00000100:00100000:0.0:1788726190.383549:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914163840 00000100:00100000:0.0:1788726190.383617:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:0.0:1788726190.383628:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:13862:x1875614914163840:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788726190.384409:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:13862:x1875614914163840:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 780us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726190.384426:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 101 00000100:00100000:3.0:1788726190.394286:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726190.394461:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914163968 00000100:00100000:1.0:1788726190.394471:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914163968 00000100:00100000:1.0:1788726190.394516:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:1.0:1788726190.394540:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:13862:x1875614914163968:12345-192.168.201.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788726190.394807:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:13862:x1875614914163968:12345-192.168.201.42@tcp:502:llog_process_th.0 Request processed in 268us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726190.394815:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 102 00000100:00100000:3.0:1788726190.398520:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726190.398751:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914164096 00000100:00100000:2.0:1788726190.398761:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914164096 00000100:00100000:2.0:1788726190.398811:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:2.0:1788726190.398819:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1875614914164096:12345-192.168.201.42@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788726190.398847:0:14314:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 939d2b7f-7fee-4708-b2b7-d0bb2f706947@192.168.201.42@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:2.0:1788726190.398886:0:14314:0:(genops.c:1385:class_connect()) connect: client 939d2b7f-7fee-4708-b2b7-d0bb2f706947, cookie 0xcbde9110e47c24a9 00000004:00100000:2.0:1788726190.398916:0:14314:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1788726190.399033:0:14314:0:(import.c:65:import_set_state_nolock()) ffff91a1398bf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788726190.399113:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:2348:x1875614914164096:12345-192.168.201.42@tcp:38:mount.lustre.0 Request processed in 292us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726190.399120:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788726190.408773:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726190.408823:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726190.409009:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914164224 00000100:00100000:2.0:1788726190.409020:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914164224 00000100:00100000:2.0:1788726190.409105:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914164352 00000100:00100000:2.0:1788726190.409108:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914164352 00000100:00100000:2.0:1788726190.409127:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:2.0:1788726190.409135:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:939d2b7f-7fee-4708-b2b7-d0bb2f706947+7:0:x1875614914164224:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788726190.409166:0:14313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788726190.409263:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:939d2b7f-7fee-4708-b2b7-d0bb2f706947+7:0:x1875614914164224:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 120us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726190.409270:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:2.0:1788726190.409288:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:2.0:1788726190.409295:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:13852:x1875614914164352:12345-192.168.201.42@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788726190.409316:0:14313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788726190.409338:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:13852:x1875614914164352:12345-192.168.201.42@tcp:41:mount.lustre.0 Request processed in 44us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726190.409345:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00080000:3.0:1788726190.409991:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726190.418316:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726190.418509:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914164480 00000100:00100000:1.0:1788726190.418519:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914164480 00000100:00100000:1.0:1788726190.418584:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:1.0:1788726190.418594:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:13852:x1875614914164480:12345-192.168.201.42@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788726190.418691:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:13852:x1875614914164480:12345-192.168.201.42@tcp:40:mount.lustre.0 Request processed in 98us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726190.418700:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:2.0:1788726190.421923:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726190.421964:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726190.422021:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726190.422110:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914164608 00000100:00100000:0.0:1788726190.422120:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914164608 00000100:00100000:0.0:1788726190.422157:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914164736 00000100:00100000:0.0:1788726190.422159:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914164736 00000100:00100000:0.0:1788726190.422179:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:0.0:1788726190.422187:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875614914164608:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788726190.422234:0:14996:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 939d2b7f-7fee-4708-b2b7-d0bb2f706947@192.168.201.42@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:0.0:1788726190.422276:0:14996:0:(genops.c:1385:class_connect()) connect: client 939d2b7f-7fee-4708-b2b7-d0bb2f706947, cookie 0xcbde9110e47c24b0 00002000:00100000:0.0:1788726190.422288:0:14996:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 939d2b7f-7fee-4708-b2b7-d0bb2f706947/ffff91a104c78800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788726190.422298:0:14996:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788726190.422395:0:14996:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788726190.422426:0:14996:0:(import.c:65:import_set_state_nolock()) ffff91a104c7e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788726190.422477:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:2348:x1875614914164608:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 290us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726190.422485:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:0.0:1788726190.422499:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:0.0:1788726190.422503:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875614914164736:12345-192.168.201.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788726190.422517:0:14996:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 939d2b7f-7fee-4708-b2b7-d0bb2f706947@192.168.201.42@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:0.0:1788726190.422533:0:14996:0:(genops.c:1385:class_connect()) connect: client 939d2b7f-7fee-4708-b2b7-d0bb2f706947, cookie 0xcbde9110e47c24b7 00002000:00100000:0.0:1788726190.422538:0:14996:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 939d2b7f-7fee-4708-b2b7-d0bb2f706947/ffff91a104c7c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788726190.422544:0:14996:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788726190.422723:0:14996:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788726190.422746:0:14996:0:(import.c:65:import_set_state_nolock()) ffff91a106699000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788726190.422767:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:2348:x1875614914164736:12345-192.168.201.42@tcp:8:mount.lustre.0 Request processed in 262us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726190.422774:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:3.0:1788726190.423066:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914164864 00000100:00100000:3.0:1788726190.423077:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914164864 00000100:00100000:3.0:1788726190.423114:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:3.0:1788726190.423121:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:13852:x1875614914164864:12345-192.168.201.42@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788726190.423177:0:14317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788726190.423332:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:13852:x1875614914164864:12345-192.168.201.42@tcp:33:mount.lustre.0 Request processed in 95us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726190.423340:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:3.0:1788726190.658459:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726190.658591:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914164992 00000100:00100000:2.0:1788726190.658601:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914164992 00000100:00100000:2.0:1788726190.658711:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:2.0:1788726190.658723:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:13883:x1875614914164992:12345-192.168.201.42@tcp:101:mkdir.0 00010000:00010000:2.0:1788726190.658745:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726190.658766:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea800/0xcbde9110e47c24be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a447 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726190.658830:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c24c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726190.658858:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c24c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726190.658871:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c24c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726190.658908:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788726190.658912:0:14313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726190.658934:0:14313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c24c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726190.658959:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea800/0xcbde9110e47c24be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a447 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726190.658976:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c24c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a447 expref: 7 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726190.658986:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:2.0:1788726190.658989:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788726190.658992:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ebc00, rc 0) 00000100:00100000:2.0:1788726190.659064:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:939d2b7f-7fee-4708-b2b7-d0bb2f706947+7:13883:x1875614914164992:12345-192.168.201.42@tcp:101:mkdir.0 Request processed in 344us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726190.659072:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00010000:00010000:3.0:1788726191.061600:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788726191.888067:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 939d2b7f-7fee-4708-b2b7-d0bb2f706947 00000001:00100000:2.0:1788726191.888084:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 459896fe-20ed-424c-974b-8a35340505e4 00010000:00010000:2.0:1788726192.091484:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726193.109683:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788726193.421389:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 459896fe-20ed-424c-974b-8a35340505e4 00000001:00100000:1.0:1788726193.421409:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 939d2b7f-7fee-4708-b2b7-d0bb2f706947 00000001:02000400:2.0:1788726193.599922:0:16277:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1788726193.915881:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 939d2b7f-7fee-4708-b2b7-d0bb2f706947 00010000:00010000:2.0:1788726194.133546:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726194.902435:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935127936:0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.902515:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726194.902557:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935128448:0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.902579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726194.902602:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788726194.902606:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935128064:0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.902630:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726194.902644:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935128576:0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.902663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726194.902684:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935128192:0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.902702:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726194.902716:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788726194.902721:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935128320:0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.902749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726194.902777:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935127936 00000100:00100000:2.0:1788726194.902785:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935127936 00000100:00100000:2.0:1788726194.902828:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788726194.902836:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:3306:x1875614935127936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.902887:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:3306:x1875614935127936:12345-0@lo:400:kworker.0 Request processed in 51us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726194.902894:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788726194.902924:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935128448 00000100:00100000:2.0:1788726194.902928:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935128448 00000100:00100000:2.0:1788726194.902960:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935128576 00000100:00100000:2.0:1788726194.902974:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935128576 00000100:00100000:2.0:1788726194.903002:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935128320 00000100:00100000:2.0:1788726194.903005:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935128320 00000100:00100000:2.0:1788726194.903017:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788726194.903022:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935128448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.903056:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935128448:12345-0@lo:400:kworker.0 Request processed in 33us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726194.903061:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788726194.903072:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788726194.903077:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935128576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.903108:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935128576:12345-0@lo:400:kworker.0 Request processed in 31us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726194.903114:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788726194.903126:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788726194.903131:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935128320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.903158:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875614935128320:12345-0@lo:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726194.903164:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788726194.903182:0:15759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935128064 00000100:00100000:2.0:1788726194.903185:0:15759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935128064 00000100:00100000:2.0:1788726194.903206:0:15759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935128192 00000100:00100000:2.0:1788726194.903208:0:15759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935128192 00000100:00100000:2.0:1788726194.903248:0:15759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788726194.903254:0:15759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935128064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.903279:0:15759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935128064:12345-0@lo:400:kworker.0 Request processed in 26us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726194.903284:0:15759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788726194.903293:0:15759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788726194.903304:0:15759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935128192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.903331:0:15759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935128192:12345-0@lo:400:kworker.0 Request processed in 28us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726194.903336:0:15759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788726194.903365:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788726194.903369:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788726194.903372:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788726194.903664:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875614935128320:0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.903678:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935128192:0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.903696:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935128704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788726194.903720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726194.904263:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788726194.904369:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935128832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788726194.904406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726194.906474:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935128064:0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.906493:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935128576:0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.906505:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935127936:0@lo:400:kworker.0 00000100:00100000:2.0:1788726194.906517:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935128448:0@lo:400:kworker.0 00000100:00100000:0.0:1788726194.907066:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935128704 00000100:00100000:0.0:1788726194.907076:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935128704 00000100:00100000:0.0:1788726194.907130:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935128832 00000100:00100000:0.0:1788726194.907134:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935128832 00000100:00100000:0.0:1788726194.907157:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788726194.907170:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935128704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788726194.907208:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726194.907311:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935128704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (3589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726194.907318:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788726194.907333:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788726194.907340:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935128832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788726194.907359:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726194.907391:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935128832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (2985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726194.907397:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788726194.907637:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935128832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788726194.907654:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935128704:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788726195.159343:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726195.643107:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726195.643155:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726195.643336:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914165248 00000100:00100000:2.0:1788726195.643357:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914165248 00000100:00100000:2.0:1788726195.643434:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:2.0:1788726195.643461:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+6:2349:x1875614914165248:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788726195.643545:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+6:2349:x1875614914165248:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 89us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726195.643553:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00080000:1.0:1788726195.643829:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726195.644237:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726195.651786:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726195.651842:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726195.651944:0:15759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914165504 00000100:00100000:0.0:1788726195.651962:0:15759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914165504 00000100:00100000:0.0:1788726195.652046:0:15759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914165760 00000100:00100000:0.0:1788726195.652050:0:15759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914165760 00000100:00100000:0.0:1788726195.652075:0:15759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:0.0:1788726195.652085:0:15759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:459896fe-20ed-424c-974b-8a35340505e4+5:2349:x1875614914165504:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726195.652169:0:15759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:459896fe-20ed-424c-974b-8a35340505e4+5:2349:x1875614914165504:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 86us (9013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726195.652191:0:15759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:0.0:1788726195.652209:0:15759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:1.0:1788726195.653357:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914165120 00000100:00100000:1.0:1788726195.653368:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914165120 00000100:00100000:1.0:1788726195.653417:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 104 00000100:00100000:1.0:1788726195.653426:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:2350:x1875614914165120:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726195.653486:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:2350:x1875614914165120:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 61us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726195.653493:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 104 00000100:00080000:1.0:1788726195.653543:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788726195.653548:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788726195.655568:0:15759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:939d2b7f-7fee-4708-b2b7-d0bb2f706947+5:2349:x1875614914165760:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726195.655648:0:15759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:939d2b7f-7fee-4708-b2b7-d0bb2f706947+5:2349:x1875614914165760:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 101us (11412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726195.655656:0:15759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:2.0:1788726195.664681:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726195.664769:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726195.664838:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914165632 00000100:00100000:3.0:1788726195.664852:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914165632 00000100:00100000:3.0:1788726195.664928:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:3.0:1788726195.664938:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:2350:x1875614914165632:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726195.665028:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:2350:x1875614914165632:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 91us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726195.665035:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00080000:1.0:1788726195.666142:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726195.677175:0:15759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914165376 00000100:00100000:0.0:1788726195.677189:0:15759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914165376 00000100:00100000:1.0:1788726195.677880:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914165888 00000100:00100000:1.0:1788726195.677889:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914165888 00000100:00100000:1.0:1788726195.677965:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:1.0:1788726195.677978:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:459896fe-20ed-424c-974b-8a35340505e4+5:2350:x1875614914165376:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726195.678070:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:459896fe-20ed-424c-974b-8a35340505e4+5:2350:x1875614914165376:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 95us (26228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726195.678079:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:1.0:1788726195.678098:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:1.0:1788726195.678105:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+5:2350:x1875614914165888:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:1.0:1788726195.678130:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+5:2350:x1875614914165888:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (13363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726195.678136:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00080000:2.0:1788726195.678502:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788726195.678508:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788726196.183972:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788726196.565861:0:14344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1788726197.164302:0:16425:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe361a1510 20000000:00000080:2.0:1788726197.164322:0:16425:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91a005ac9400 uarg=0000000000000000 20000000:01000000:2.0:1788726197.164359:0:16425:0:(mgs_llog.c:6195:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788726197.164365:0:16425:0:(mgs_llog.c:4650:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788726197.164369:0:16425:0:(mgs_llog.c:1382:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788726197.165079:0:16426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788726197.165364:0:16425:0:(mgs_llog.c:1453:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788726197.173478:0:16425:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788726197.173510:0:16425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a1398eb600/0xcbde9110e47c24cc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726197.173530:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a1398eb800/0xcbde9110e47c21c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c21bc expref: 18 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726197.173537:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a10e725200/0xcbde9110e47c2210 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c2209 expref: 18 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726197.173544:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a1398ea200/0xcbde9110e47c2280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c2279 expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726197.173553:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a108920800/0xcbde9110e47c246a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a3bb expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726197.173576:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a1398eaa00/0xcbde9110e47c24a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a41d expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726197.173584:0:16425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a1398eb600/0xcbde9110e47c24cc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726197.173629:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a1398eaa00/0xcbde9110e47c24a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a41d expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726197.173645:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a1398eaa00/0xcbde9110e47c24a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a41d expref: 12 pid: 14308 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726197.173660:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111611500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1875614935128960:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726197.174072:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a108920800/0xcbde9110e47c246a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a3bb expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726197.174081:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a108920800/0xcbde9110e47c246a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a3bb expref: 12 pid: 14307 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726197.174090:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111611c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1875614935129088:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726197.174129:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a1398ea200/0xcbde9110e47c2280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c2279 expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726197.174147:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a1398ea200/0xcbde9110e47c2280 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c2279 expref: 18 pid: 14305 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726197.174156:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111612300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1875614935129216:0@lo:104: 00000100:00100000:2.0:1788726197.174198:0:16425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788726197.174294:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a10e725200/0xcbde9110e47c2210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c2209 expref: 18 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726197.174302:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a10e725200/0xcbde9110e47c2210 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c2209 expref: 18 pid: 14308 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726197.174310:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111610380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1875614935129344:0@lo:104: 00000100:00100000:2.0:1788726197.174332:0:16425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788726197.174362:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a1398eb800/0xcbde9110e47c21c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbde9110e47c21bc expref: 18 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726197.174370:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a1398eb800/0xcbde9110e47c21c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbde9110e47c21bc expref: 18 pid: 14307 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726197.174377:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111611180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1875614935129472:0@lo:104: 00000100:00100000:2.0:1788726197.174401:0:16425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726197.174410:0:16425:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111795cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726197.174545:0:14297:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788726197.174561:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935129216 00000100:00100000:0.0:1788726197.174569:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935129216 00000100:00100000:0.0:1788726197.174610:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935129344 00000100:00100000:0.0:1788726197.174614:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935129344 00000100:00100000:0.0:1788726197.174623:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935129472 00000100:00100000:0.0:1788726197.174625:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935129472 00000100:00100000:0.0:1788726197.174637:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788726197.174646:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+5:16425:x1875614935129216:12345-0@lo:104: 00010000:00010000:0.0:1788726197.174659:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c2279 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c2280 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.174721:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788726197.174727:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+5:16425:x1875614935129216:12345-0@lo:104: Request processed in 82us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726197.174746:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788726197.174763:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788726197.174769:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+4:16425:x1875614935129344:12345-0@lo:104: 00010000:00010000:0.0:1788726197.174783:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a108921000/0xcbde9110e47c2209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c2210 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.174829:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788726197.174834:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+4:16425:x1875614935129344:12345-0@lo:104: Request processed in 66us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726197.174841:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788726197.174853:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788726197.174859:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a139cec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+3:16425:x1875614935129472:12345-0@lo:104: 00010000:00010000:0.0:1788726197.174866:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.142@tcp lock: ffff91a13a915e00/0xcbde9110e47c21bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c21c3 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.174890:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788726197.174895:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a139cec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+3:16425:x1875614935129472:12345-0@lo:104: Request processed in 37us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726197.174901:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788726197.174965:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788726197.174971:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c2279 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c2280 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.174979:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a10e724600 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788726197.174984:0:14301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c2279 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c2280 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.174993:0:14301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c2279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c2280 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788726197.175002:0:14301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c2279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c2280 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726197.175016:0:14301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788726197.175049:0:14301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c2279 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c2280 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175055:0:14301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788726197.175075:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c2279 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c2280 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175082:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a10e724600/0xcbde9110e47c2279 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c2280 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175097:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788726197.175100:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a108921000/0xcbde9110e47c2209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c2210 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175105:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921000 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788726197.175108:0:14301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a108921000/0xcbde9110e47c2209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c2210 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175115:0:14301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a108921000/0xcbde9110e47c2209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c2210 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788726197.175121:0:14301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a108921000/0xcbde9110e47c2209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c2210 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726197.175127:0:14301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788726197.175150:0:14301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a108921000/0xcbde9110e47c2209 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c2210 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175156:0:14301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788726197.175169:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a108921000/0xcbde9110e47c2209 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c2210 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175176:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a108921000/0xcbde9110e47c2209 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c2210 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175185:0:14301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726197.175188:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.142@tcp lock: ffff91a13a915e00/0xcbde9110e47c21bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbde9110e47c21c3 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175194:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a13a915e00 already unused, calling callback (ffffffffc1a27c20) 10000000:00010000:0.0:1788726197.175197:0:14301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.142@tcp lock: ffff91a13a915e00/0xcbde9110e47c21bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbde9110e47c21c3 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175203:0:14301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.142@tcp lock: ffff91a13a915e00/0xcbde9110e47c21bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbde9110e47c21c3 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788726197.175209:0:14301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.142@tcp lock: ffff91a13a915e00/0xcbde9110e47c21bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbde9110e47c21c3 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726197.175239:0:14301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788726197.175254:0:14301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.142@tcp lock: ffff91a13a915e00/0xcbde9110e47c21bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c21c3 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175260:0:14301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788726197.175275:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.142@tcp lock: ffff91a13a915e00/0xcbde9110e47c21bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c21c3 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175282:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.142@tcp lock: ffff91a13a915e00/0xcbde9110e47c21bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbde9110e47c21c3 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175305:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726197.175307:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726197.175309:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726197.175332:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935129600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726197.175365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726197.175389:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788726197.175394:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935129728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726197.175414:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726197.175440:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3304:1875614935129856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726197.175464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726197.175495:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935129600 00000100:00100000:0.0:1788726197.175500:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935129600 00010000:00010000:0.0:1788726197.175518:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a1398ea200/0xcbde9110e47c2280 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c2279 expref: 19 pid: 14305 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726197.175534:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935129728 00000100:00100000:0.0:1788726197.175537:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935129728 00010000:00010000:0.0:1788726197.175545:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a10e725200/0xcbde9110e47c2210 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c2209 expref: 20 pid: 14308 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726197.175555:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935129856 00000100:00100000:0.0:1788726197.175557:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935129856 00010000:00010000:0.0:1788726197.175565:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a1398eb800/0xcbde9110e47c21c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c21bc expref: 21 pid: 14307 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726197.175576:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788726197.175582:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+21:3306:x1875614935129600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726197.175600:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726197.175606:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a1398ea200/0xcbde9110e47c2280 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c2279 expref: 21 pid: 14305 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175616:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a1398ea200/0xcbde9110e47c2280 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c2279 expref: 21 pid: 14305 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175632:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726197.175660:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+21:3306:x1875614935129600:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726197.175666:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788726197.175679:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788726197.175685:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+20:3306:x1875614935129728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726197.175691:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726197.175696:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a10e725200/0xcbde9110e47c2210 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c2209 expref: 20 pid: 14308 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175703:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a10e725200/0xcbde9110e47c2210 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c2209 expref: 20 pid: 14308 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175712:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726197.175731:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+20:3306:x1875614935129728:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726197.175737:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788726197.175748:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788726197.175753:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ae73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:3304:x1875614935129856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726197.175760:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726197.175763:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a1398eb800/0xcbde9110e47c21c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbde9110e47c21bc expref: 19 pid: 14307 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175778:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a1398eb800/0xcbde9110e47c21c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbde9110e47c21bc expref: 19 pid: 14307 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.175787:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726197.175812:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ae73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:3304:x1875614935129856:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726197.175818:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788726197.175867:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3304:1875614935129856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726197.175890:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935129728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726197.175897:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141c49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3306:1875614935129600:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788726197.176524:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a1398ea200/0xcbde9110e47c2280 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c2279 expref: 18 pid: 14305 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726197.176538:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111612300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1875614935129216:0@lo:104: 00010000:00010000:2.0:1788726197.176550:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a10e725200/0xcbde9110e47c2210 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c2209 expref: 17 pid: 14308 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726197.176558:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111610380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1875614935129344:0@lo:104: 00010000:00010000:2.0:1788726197.176566:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a1398eb800/0xcbde9110e47c21c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbde9110e47c21bc expref: 16 pid: 14307 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726197.176574:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111611180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1875614935129472:0@lo:104: 00010000:00010000:3.0:1788726197.177668:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726197.179437:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111611500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1875614935128960:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726197.182169:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111611c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1875614935129088:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788726197.182345:0:16425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a1398eb600/0xcbde9110e47c24cc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726197.186013:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726197.186108:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726197.186365:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914166016 00000100:00100000:0.0:1788726197.186375:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914166016 00000100:00100000:1.0:1788726197.186460:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914166144 00000100:00100000:1.0:1788726197.186465:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914166144 00010000:00010000:1.0:1788726197.186484:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a108920800/0xcbde9110e47c246a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a3bb expref: 14 pid: 14307 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186485:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a1398eaa00/0xcbde9110e47c24a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a41d expref: 14 pid: 14308 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726197.186516:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:0.0:1788726197.186527:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab7e8877-a281-4332-b6fb-e13d74566ae9+14:2349:x1875614914166016:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726197.186541:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726197.186547:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a1398eaa00/0xcbde9110e47c24a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a41d expref: 14 pid: 14308 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186560:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a1398eaa00/0xcbde9110e47c24a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a41d expref: 14 pid: 14308 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186579:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a1398eaa00/0xcbde9110e47c24a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a41d expref: 14 pid: 14308 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186610:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726197.186806:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:2349:x1875614914166016:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 279us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726197.186815:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:0.0:1788726197.186834:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:0.0:1788726197.186841:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab7e8877-a281-4332-b6fb-e13d74566ae9+12:2350:x1875614914166144:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726197.186851:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726197.186856:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a108920800/0xcbde9110e47c246a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a3bb expref: 12 pid: 14307 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186865:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a108920800/0xcbde9110e47c246a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a3bb expref: 12 pid: 14307 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186875:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a108920800/0xcbde9110e47c246a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a3bb expref: 12 pid: 14307 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186887:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a1398eb600/0xcbde9110e47c24cc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186895:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398eb600/0xcbde9110e47c24cc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186912:0:14299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a1398eb600/0xcbde9110e47c24cc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186919:0:14299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a1398eb600/0xcbde9110e47c24cc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186947:0:14299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a1398eb600/0xcbde9110e47c24cc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186954:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a1398eb600/0xcbde9110e47c24cc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186959:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb600 already unused, calling callback (ffffffffc142a230) 00010000:00010000:0.0:1788726197.186964:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a1398eb600/0xcbde9110e47c24cc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186972:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a1398eb600/0xcbde9110e47c24cc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186988:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a1398eb600/0xcbde9110e47c24cc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.186998:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726197.187021:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab7e8877-a281-4332-b6fb-e13d74566ae9+11:2350:x1875614914166144:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 180us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726197.187028:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00010000:00010000:2.0:1788726197.188157:0:16425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a1398eb600/0xcbde9110e47c24cc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726197.188263:0:16425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a1398eb600/0xcbde9110e47c24cc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726197.188272:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a1398eb600/0xcbde9110e47c24cc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726197.206547:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726198.229627:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726198.258192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726198.258852:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914166272 00000100:00100000:2.0:1788726198.258865:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914166272 00000100:00100000:2.0:1788726198.258934:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:2.0:1788726198.258945:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+11:13738:x1875614914166272:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726198.258962:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726198.258983:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a1398ea000/0xcbde9110e47c24d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be9055a44e expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726198.259012:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a1398ea000/0xcbde9110e47c24d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a44e expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726198.259025:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a1398ea000/0xcbde9110e47c24d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a44e expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726198.259034:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea000, rc 0) 00000100:00100000:2.0:1788726198.259096:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+12:13738:x1875614914166272:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 Request processed in 152us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726198.259104:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 105 00000100:00100000:3.0:1788726198.265856:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726198.272386:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914166400 00000100:00100000:1.0:1788726198.272404:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914166400 00000100:00100000:1.0:1788726198.272508:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:1.0:1788726198.272519:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+12:13738:x1875614914166400:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788726198.272834:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+12:13738:x1875614914166400:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 Request processed in 316us (6987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726198.272843:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 106 00000100:00100000:2.0:1788726198.279177:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726198.279489:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914166528 00000100:00100000:3.0:1788726198.279500:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914166528 00000100:00100000:3.0:1788726198.279558:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 107 00000100:00100000:3.0:1788726198.279568:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+12:13738:x1875614914166528:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726198.279804:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+12:13738:x1875614914166528:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 Request processed in 237us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726198.279812:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 107 00000100:00100000:3.0:1788726198.291435:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726198.291487:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914166656 00000100:00100000:1.0:1788726198.291497:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914166656 00000100:00100000:1.0:1788726198.291566:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:1.0:1788726198.291579:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+12:13738:x1875614914166656:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788726198.291597:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726198.291614:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a108921200/0xcbde9110e47c24da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x228275be9055a455 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726198.291643:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a108921200/0xcbde9110e47c24da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a455 expref: 13 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726198.291653:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a108921200/0xcbde9110e47c24da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a455 expref: 13 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726198.291662:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921200, rc 0) 00000100:00100000:1.0:1788726198.291718:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:13738:x1875614914166656:12345-192.168.201.42@tcp:101:ll_cfg_requeue.0 Request processed in 142us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726198.291725:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 108 00000100:00100000:3.0:1788726198.294871:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726198.295354:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914166784 00000100:00100000:2.0:1788726198.295366:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914166784 00000100:00100000:2.0:1788726198.295950:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:2.0:1788726198.295962:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:13738:x1875614914166784:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788726198.296282:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:13738:x1875614914166784:12345-192.168.201.42@tcp:501:ll_cfg_requeue.0 Request processed in 321us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726198.296291:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 109 00000100:00100000:3.0:1788726198.301339:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726198.301381:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914166912 00000100:00100000:3.0:1788726198.301403:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914166912 00000100:00100000:3.0:1788726198.301448:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 110 00000100:00100000:3.0:1788726198.301458:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:13738:x1875614914166912:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726198.301660:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:13738:x1875614914166912:12345-192.168.201.42@tcp:503:ll_cfg_requeue.0 Request processed in 203us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726198.301669:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 110 10000000:01000000:0.0:1788726198.805400:0:14310:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788726198.805407:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a10579f800 from 10 10000000:01000000:0.0:1788726198.805412:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788726198.805466:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a005fb7200/0xcbde9110e47c24e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726198.805479:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a005fb7200/0xcbde9110e47c24e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726198.805513:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a005fb7200/0xcbde9110e47c24e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726198.805540:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935129984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788726198.805612:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726198.805682:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13aed0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788726198.805826:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935129984 00000100:00100000:3.0:1788726198.805835:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935129984 00000100:00100000:3.0:1788726198.805891:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788726198.805911:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+16:14310:x1875614935129984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726198.805934:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726198.805947:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a0050d7600/0xcbde9110e47c24e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c24e1 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726198.805971:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a0050d7600/0xcbde9110e47c24e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c24e1 expref: 17 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726198.805981:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a0050d7600/0xcbde9110e47c24e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c24e1 expref: 17 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726198.805989:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a0050d7600, rc 0) 00000100:00100000:3.0:1788726198.806038:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:14310:x1875614935129984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726198.806044:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788726198.806149:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935129984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726198.806164:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a005fb7200/0xcbde9110e47c24e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c24e8 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726198.806172:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a005fb7200/0xcbde9110e47c24e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c24e8 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726198.806262:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111612a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935130112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788726198.806301:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726198.806574:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111795780 going to sleep for 11 seconds 00000100:00100000:0.0:1788726198.806714:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935130112 00000100:00100000:0.0:1788726198.806720:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935130112 00000100:00100000:0.0:1788726198.806756:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788726198.806765:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:14310:x1875614935130112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788726198.807032:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:14310:x1875614935130112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726198.807041:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788726198.807133:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111612a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935130112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788726198.807166:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111612a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935130240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788726198.807206:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726198.807255:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111795780 going to sleep for 11 seconds 00000100:00100000:0.0:1788726198.807414:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935130240 00000100:00100000:0.0:1788726198.807420:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935130240 00000100:00100000:0.0:1788726198.807441:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788726198.807447:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b3a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:14310:x1875614935130240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788726198.807597:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b3a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:14310:x1875614935130240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726198.807605:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788726198.807748:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111612a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935130240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788726198.808790:0:16493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788726198.808966:0:14310:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788726198.808984:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788726198.808994:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a005fb7200/0xcbde9110e47c24e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c24e8 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726198.809004:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a005fb7200/0xcbde9110e47c24e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c24e8 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726198.809023:0:14310:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788726198.809025:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a139f03000 from 10 10000000:01000000:0.0:1788726198.809028:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788726198.809057:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a005fb7800/0xcbde9110e47c24ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726198.809065:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a005fb7800/0xcbde9110e47c24ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726198.809076:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a005fb7800/0xcbde9110e47c24ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726198.809097:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935130368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788726198.809240:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726198.809283:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13aed03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726198.809498:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935130368 00000100:00100000:1.0:1788726198.809505:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935130368 00000100:00100000:1.0:1788726198.809553:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788726198.809563:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+17:14310:x1875614935130368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788726198.809574:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726198.809587:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a108920a00/0xcbde9110e47c24f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c24ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726198.809610:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a108920a00/0xcbde9110e47c24f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c24ef expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726198.809620:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a108920a00/0xcbde9110e47c24f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c24ef expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726198.809638:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920a00, rc 0) 00000100:00100000:1.0:1788726198.809682:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:14310:x1875614935130368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726198.809688:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788726198.809949:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935130368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726198.809964:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a005fb7800/0xcbde9110e47c24ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c24f6 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726198.809986:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a005fb7800/0xcbde9110e47c24ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c24f6 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726198.810042:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111612a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935130496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788726198.810071:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726198.810101:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111795240 going to sleep for 11 seconds 00000100:00100000:3.0:1788726198.810373:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935130496 00000100:00100000:3.0:1788726198.810379:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935130496 00000100:00100000:3.0:1788726198.810412:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788726198.810419:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c02a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:14310:x1875614935130496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726198.810665:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c02a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:14310:x1875614935130496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726198.810672:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788726198.810707:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111612a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935130496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726198.810738:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141ac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935130624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726198.810779:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726198.810794:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a102aa1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788726198.810807:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935130624 00000100:00100000:3.0:1788726198.810810:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935130624 00000100:00100000:3.0:1788726198.810834:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788726198.810839:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:14310:x1875614935130624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726198.810992:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:14310:x1875614935130624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726198.810999:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788726198.811031:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141ac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935130624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788726198.811710:0:16494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788726198.811756:0:14310:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788726198.811771:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788726198.811780:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a005fb7800/0xcbde9110e47c24ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c24f6 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726198.811789:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a005fb7800/0xcbde9110e47c24ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c24f6 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726198.811799:0:14310:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788726198.811802:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91a13ad4c800 from 10 10000000:01000000:3.0:1788726198.811805:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788726198.811829:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a0050d6e00/0xcbde9110e47c24fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726198.811836:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.142@tcp lock: ffff91a0050d6e00/0xcbde9110e47c24fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726198.811845:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.142@tcp lock: ffff91a0050d6e00/0xcbde9110e47c24fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726198.811861:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141ac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935130752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788726198.811894:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726198.811931:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a102aa1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788726198.811947:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935130752 00000100:00100000:3.0:1788726198.811951:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935130752 00000100:00100000:3.0:1788726198.811973:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788726198.811979:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c02b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+18:14310:x1875614935130752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726198.811987:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726198.811998:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a0050d7200/0xcbde9110e47c2504 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbde9110e47c24fd expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726198.812016:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a0050d7200/0xcbde9110e47c2504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbde9110e47c24fd expref: 19 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726198.812025:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a0050d7200/0xcbde9110e47c2504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbde9110e47c24fd expref: 19 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726198.812032:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a0050d7200, rc 0) 00000100:00100000:3.0:1788726198.812063:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c02b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:14310:x1875614935130752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726198.812070:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788726198.812100:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141ac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935130752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726198.812112:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.142@tcp lock: ffff91a0050d6e00/0xcbde9110e47c24fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2504 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726198.812120:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.142@tcp lock: ffff91a0050d6e00/0xcbde9110e47c24fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbde9110e47c2504 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726198.812159:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141ac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935130880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726198.812184:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726198.812205:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a102aa1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788726198.812238:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935130880 00000100:00100000:3.0:1788726198.812242:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935130880 00000100:00100000:3.0:1788726198.812260:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788726198.812266:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c02b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:14310:x1875614935130880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726198.812454:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c02b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:14310:x1875614935130880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726198.812460:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788726198.812488:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141ac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935130880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726198.812511:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141ac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935131008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726198.812545:0:14310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726198.812559:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a102aa1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788726198.812571:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935131008 00000100:00100000:3.0:1788726198.812575:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935131008 00000100:00100000:3.0:1788726198.812591:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788726198.812596:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:14310:x1875614935131008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726198.812722:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:14310:x1875614935131008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726198.812728:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788726198.812761:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141ac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:14310:1875614935131008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788726198.813500:0:16495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788726198.813549:0:14310:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788726198.813562:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788726198.813570:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.142@tcp lock: ffff91a0050d6e00/0xcbde9110e47c24fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2504 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726198.813592:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.142@tcp lock: ffff91a0050d6e00/0xcbde9110e47c24fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbde9110e47c2504 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726199.254244:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726200.022259:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3305:1875614935131136:0@lo:400:kworker.0 00000100:00100000:3.0:1788726200.022356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726200.022419:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935131648:0@lo:400:kworker.0 00000100:00100000:3.0:1788726200.022449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726200.022476:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788726200.022481:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935131520:0@lo:400:kworker.0 00000100:00100000:1.0:1788726200.022498:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935131648 00000100:00100000:3.0:1788726200.022503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726200.022507:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935131648 00000100:00100000:3.0:1788726200.022526:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935131520 00000100:00100000:3.0:1788726200.022530:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935131520 00000100:00100000:2.0:1788726200.022589:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935131136 00000100:00100000:2.0:1788726200.022594:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935131136 00000100:00100000:2.0:1788726200.022625:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788726200.022634:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:3305:x1875614935131136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726200.022641:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a1111d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935132032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788726200.022685:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:3305:x1875614935131136:12345-0@lo:400:kworker.0 Request processed in 52us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726200.022685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726200.022692:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788726200.022712:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935131264:0@lo:400:kworker.0 00000100:00100000:2.0:1788726200.022739:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935132032 00000100:00100000:0.0:1788726200.022740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726200.022742:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935132032 00000100:00100000:0.0:1788726200.022757:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935131776:0@lo:400:kworker.0 00000100:00100000:2.0:1788726200.022770:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788726200.022777:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935132032:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788726200.022777:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726200.022794:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788726200.022800:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935131392:0@lo:400:kworker.0 00002000:00000024:2.0:1788726200.022805:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726200.022817:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726200.022833:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935131904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788726200.022834:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935132032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726200.022840:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788726200.022851:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726200.022888:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3305:1875614935131136:0@lo:400:kworker.0 00000100:00100000:2.0:1788726200.022916:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935131776 00000100:00100000:2.0:1788726200.022919:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935131776 00000100:00100000:0.0:1788726200.022925:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935131264 00000100:00100000:0.0:1788726200.022929:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935131264 00000100:00100000:0.0:1788726200.022952:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935131392 00000100:00100000:0.0:1788726200.022956:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935131392 00000100:00100000:0.0:1788726200.022973:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788726200.022980:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935131264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726200.023017:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935131264:12345-0@lo:400:kworker.0 Request processed in 37us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726200.023023:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788726200.023035:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788726200.023040:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935131392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726200.023633:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935131392:12345-0@lo:400:kworker.0 Request processed in 590us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726200.023640:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788726200.023700:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a1111d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935132032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788726200.023725:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935131904 00000100:00100000:0.0:1788726200.023730:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935131904 00000100:00100000:0.0:1788726200.023773:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788726200.023780:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935131904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788726200.023800:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726200.023829:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875614935131904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726200.023836:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788726200.023861:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935131392:0@lo:400:kworker.0 00000100:00100000:0.0:1788726200.023874:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935131904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788726200.023897:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935131264:0@lo:400:kworker.0 00000100:00100000:3.0:1788726200.027780:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788726200.027808:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935131648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726200.029067:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875614935131648:12345-0@lo:400:kworker.0 Request processed in 1268us (6610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726200.029080:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788726200.029114:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788726200.029127:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935131520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726200.029177:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935131520:12345-0@lo:400:kworker.0 Request processed in 56us (6673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726200.029184:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788726200.029266:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935131520:0@lo:400:kworker.0 00000100:00100000:3.0:1788726200.029280:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875614935131648:0@lo:400:kworker.0 00000100:00080000:3.0:1788726200.029357:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788726200.029363:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788726200.029366:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788726200.040503:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788726200.040531:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935131776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726200.040729:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875614935131776:12345-0@lo:400:kworker.0 Request processed in 213us (17949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726200.040737:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788726200.049320:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875614935131776:0@lo:400:kworker.0 00010000:00010000:3.0:1788726200.278556:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726200.745809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726200.745917:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914167040 00000100:00100000:0.0:1788726200.745929:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914167040 00000100:00100000:0.0:1788726200.745988:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:0.0:1788726200.745999:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c02a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:2349:x1875614914167040:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:0.0:1788726200.746073:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c02a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:2349:x1875614914167040:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 74us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726200.746081:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 121 00000100:00100000:3.0:1788726200.746860:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726200.746916:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726200.746949:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726200.746985:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726200.747005:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726200.747044:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726200.747083:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914167296 00000100:00100000:3.0:1788726200.747093:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914167296 00000100:00100000:2.0:1788726200.747263:0:15759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914167808 00000100:00100000:2.0:1788726200.747270:0:15759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914167808 00000100:00100000:2.0:1788726200.747320:0:15759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914167424 00000100:00100000:2.0:1788726200.747324:0:15759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914167424 00000100:00100000:2.0:1788726200.747339:0:15759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914167680 00000100:00100000:2.0:1788726200.747341:0:15759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914167680 00000100:00100000:2.0:1788726200.747358:0:15759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:2.0:1788726200.747367:0:15759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:939d2b7f-7fee-4708-b2b7-d0bb2f706947+5:2349:x1875614914167808:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788726200.747439:0:15759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:939d2b7f-7fee-4708-b2b7-d0bb2f706947+5:2349:x1875614914167808:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 73us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726200.747448:0:15759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:2.0:1788726200.747473:0:15759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:2.0:1788726200.747479:0:15759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:459896fe-20ed-424c-974b-8a35340505e4+5:2349:x1875614914167424:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788726200.747503:0:15759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:459896fe-20ed-424c-974b-8a35340505e4+5:2349:x1875614914167424:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726200.747510:0:15759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:2.0:1788726200.747521:0:15759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:2.0:1788726200.747527:0:15759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:939d2b7f-7fee-4708-b2b7-d0bb2f706947+5:2349:x1875614914167680:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788726200.747550:0:15759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:939d2b7f-7fee-4708-b2b7-d0bb2f706947+5:2349:x1875614914167680:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726200.747556:0:15759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:2.0:1788726200.747604:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914167552 00000100:00100000:2.0:1788726200.747608:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914167552 00000100:00100000:2.0:1788726200.747638:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914167168 00000100:00100000:2.0:1788726200.747642:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914167168 00000100:00100000:2.0:1788726200.747662:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:2.0:1788726200.747668:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:2349:x1875614914167552:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788726200.747702:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:2349:x1875614914167552:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 34us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726200.747709:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:2.0:1788726200.747720:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:2.0:1788726200.747726:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+6:2349:x1875614914167168:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:2.0:1788726200.747749:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+6:2349:x1875614914167168:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 23us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726200.747755:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00080000:2.0:1788726200.747785:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788726200.747791:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788726200.747793:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788726200.748492:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:3.0:1788726200.748504:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:459896fe-20ed-424c-974b-8a35340505e4+5:2349:x1875614914167296:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726200.748561:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:459896fe-20ed-424c-974b-8a35340505e4+5:2349:x1875614914167296:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 61us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726200.748569:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:3.0:1788726201.077296:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726201.080634:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914167936 00000100:00100000:2.0:1788726201.080655:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914167936 00000100:00100000:2.0:1788726201.080755:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:2.0:1788726201.080767:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+6:14394:x1875614914167936:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726201.080792:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726201.080818:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea800/0xcbde9110e47c250b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a45c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.080912:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2512 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.080949:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2512 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.080967:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2512 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.080983:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c2519 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.080988:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c2519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.080993:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c2519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081393:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c2520 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081399:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c2520 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081405:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c2520 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726201.081429:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788726201.081433:0:14313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726201.081617:0:14313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c2520 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081629:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2512 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081645:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2512 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081652:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2512 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081657:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726201.081661:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2512 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081668:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2512 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081680:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:2.0:1788726201.081683:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726201.081691:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2512 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081697:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2512 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081709:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c2519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081714:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c2519 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081720:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c2519 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081724:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eba00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726201.081731:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c2519 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081737:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c2519 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081743:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91a11214c800) 00010000:00010000:2.0:1788726201.081745:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726201.081747:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c2519 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081752:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c2519 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081789:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea800/0xcbde9110e47c250b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a45c expref: 8 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081802:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea200/0xcbde9110e47c2520 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a45c expref: 7 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.081809:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91a11214c300) 00010000:00010000:2.0:1788726201.081811:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788726201.081813:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea200, rc 0) 00000100:00100000:2.0:1788726201.081958:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+7:14394:x1875614914167936:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 1192us (4674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726201.081966:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:1.0:1788726201.095972:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726201.097576:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914168192 00000100:00100000:2.0:1788726201.097593:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914168192 00000100:00100000:2.0:1788726201.097662:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:2.0:1788726201.097673:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+7:14394:x1875614914168192:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726201.097708:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726201.097729:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea800/0xcbde9110e47c2527 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a463 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.097808:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c252e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.097822:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c252e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.097834:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c252e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.098550:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2535 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.098565:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2535 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.098575:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2535 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099420:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7600/0xcbde9110e47c253c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099434:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7600/0xcbde9110e47c253c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099445:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7600/0xcbde9110e47c253c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726201.099455:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788726201.099665:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c252e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099673:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c252e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099679:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c252e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099685:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eba00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726201.099689:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c252e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099696:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c252e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099716:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91a11214c300) 00010000:00010000:0.0:1788726201.099719:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726201.099723:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c252e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099729:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c252e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099743:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2535 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099749:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2535 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099755:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2535 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099759:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726201.099762:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2535 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099767:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2535 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099775:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91a11214c800) 00010000:00010000:0.0:1788726201.099777:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726201.099780:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2535 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.099785:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2535 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.100685:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea800/0xcbde9110e47c2527 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a463 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.100704:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7600/0xcbde9110e47c253c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a463 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.100712:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a1132f1100) 00010000:00010000:0.0:1788726201.100714:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726201.100717:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a005fb7600, rc 0) 00000100:00100000:0.0:1788726201.100799:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+9:14394:x1875614914168192:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 3127us (4834us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788726201.100808:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:1.0:1788726201.107457:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726201.113454:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914168320 00000100:00100000:3.0:1788726201.113470:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914168320 00000100:00100000:3.0:1788726201.113546:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:3.0:1788726201.113557:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+9:14394:x1875614914168320:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788726201.113670:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+9:14394:x1875614914168320:12345-192.168.201.42@tcp:59:lhsmtool_posix.0 Request processed in 114us (6222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726201.113677:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:1.0:1788726201.190738:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726201.190909:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914168448 00000100:00100000:0.0:1788726201.190921:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914168448 00000100:00100000:0.0:1788726201.190998:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:0.0:1788726201.191010:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+9:14400:x1875614914168448:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726201.191032:0:15361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726201.191052:0:15361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7000/0xcbde9110e47c254a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a46a expref: -99 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191330:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7e00/0xcbde9110e47c2551 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191346:0:15361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7e00/0xcbde9110e47c2551 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191357:0:15361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7e00/0xcbde9110e47c2551 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191388:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6200/0xcbde9110e47c2558 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191395:0:15361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6200/0xcbde9110e47c2558 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191402:0:15361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6200/0xcbde9110e47c2558 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191586:0:15361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7e00/0xcbde9110e47c2551 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191594:0:15361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7e00/0xcbde9110e47c2551 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191601:0:15361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7e00/0xcbde9110e47c2551 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191606:0:15361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a005fb7e00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726201.191610:0:15361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7e00/0xcbde9110e47c2551 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191618:0:15361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7e00/0xcbde9110e47c2551 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191631:0:15361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:0.0:1788726201.191634:0:15361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726201.191640:0:15361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7e00/0xcbde9110e47c2551 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191646:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7e00/0xcbde9110e47c2551 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191667:0:15361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6200/0xcbde9110e47c2558 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191673:0:15361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6200/0xcbde9110e47c2558 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191679:0:15361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6200/0xcbde9110e47c2558 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191684:0:15361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a005fb6200 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726201.191687:0:15361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6200/0xcbde9110e47c2558 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191694:0:15361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6200/0xcbde9110e47c2558 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191702:0:15361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91a1132f1000) 00010000:00010000:0.0:1788726201.191704:0:15361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726201.191707:0:15361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6200/0xcbde9110e47c2558 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191712:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6200/0xcbde9110e47c2558 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191743:0:15361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7000/0xcbde9110e47c254a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a46a expref: 10 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.191754:0:15361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:0.0:1788726201.191756:0:15361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726201.192496:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7000/0xcbde9110e47c254a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a46a expref: 10 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.192513:0:15361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a005fb7000, rc 0) 00000100:00100000:0.0:1788726201.192595:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+9:14400:x1875614914168448:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1585us (1864us total) trans 0 rc 301/301 00000100:00100000:0.0:1788726201.192603:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:1.0:1788726201.205566:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726201.206269:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914168576 00000100:00100000:3.0:1788726201.206281:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914168576 00000100:00100000:3.0:1788726201.206353:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:3.0:1788726201.206364:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:459896fe-20ed-424c-974b-8a35340505e4+9:14400:x1875614914168576:12345-192.168.201.42@tcp:700:lfs.0 00000100:00100000:3.0:1788726201.206463:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:459896fe-20ed-424c-974b-8a35340505e4+9:14400:x1875614914168576:12345-192.168.201.42@tcp:700:lfs.0 Request processed in 101us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726201.206471:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:2.0:1788726201.210580:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726201.210688:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914168832 00000100:00100000:3.0:1788726201.210699:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914168832 00000100:00100000:3.0:1788726201.210810:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 19 00000100:00100000:3.0:1788726201.210821:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+9:14400:x1875614914168832:12345-192.168.201.42@tcp:36:lfs.0 00010000:00010000:3.0:1788726201.210891:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726201.210917:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c248d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a3e5 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726201.210938:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:3.0:1788726201.210943:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788726201.211192:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6a00/0xcbde9110e47c255f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726201.211207:0:14314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c24c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a447 expref: 5 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726201.214299:0:14314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6a00/0xcbde9110e47c255f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.215073:0:14314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c24c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a447 expref: 5 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.215101:0:14314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c24c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a447 expref: 5 pid: 14313 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726201.215127:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111611180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1875614935132160:192.168.201.42@tcp:104: 00000100:00100000:2.0:1788726201.215269:0:14314:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12affa540 going to sleep for 11 seconds 00000100:00100000:2.0:1788726201.221668:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111611180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1875614935132160:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726201.221703:0:14314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6a00/0xcbde9110e47c255f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726201.227870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726201.228352:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914168960 00000100:00100000:1.0:1788726201.228363:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914168960 00010000:00010000:1.0:1788726201.228404:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c24c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a447 expref: 6 pid: 14313 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726201.228448:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:1.0:1788726201.228459:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:2349:x1875614914168960:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726201.228477:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726201.228484:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c24c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a447 expref: 6 pid: 14313 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.228498:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c24c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a447 expref: 6 pid: 14313 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.228538:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c24c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a447 expref: 6 pid: 14313 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.228558:0:14298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:1.0:1788726201.228563:0:14298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6a00/0xcbde9110e47c255f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.228571:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6a00/0xcbde9110e47c255f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.228578:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6a00/0xcbde9110e47c255f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.228608:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726201.228659:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:939d2b7f-7fee-4708-b2b7-d0bb2f706947+5:2349:x1875614914168960:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 202us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726201.228666:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00010000:00010000:2.0:1788726201.229129:0:14314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6a00/0xcbde9110e47c255f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.229138:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6a00/0xcbde9110e47c255f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.229162:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2566 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.229172:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2566 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.229179:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2566 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726201.230579:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788726201.230594:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6a00/0xcbde9110e47c255f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.230603:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6a00/0xcbde9110e47c255f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.230610:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6a00/0xcbde9110e47c255f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.230616:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d6a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726201.230628:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6a00/0xcbde9110e47c255f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.230635:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6a00/0xcbde9110e47c255f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.230650:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a10d14db00) 00010000:00010000:2.0:1788726201.230654:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726201.230658:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6a00/0xcbde9110e47c255f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.230664:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6a00/0xcbde9110e47c255f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788726201.230683:0:14314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7f73040 reply state 000000008f19fa10 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2566 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726201.230692:0:14314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788726201.230793:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+10:14400:x1875614914168832:12345-192.168.201.42@tcp:36:lfs.0 Request processed in 19970us (20219us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788726201.230802:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 19 00010000:00010000:1.0:1788726201.238765:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2566 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.238783:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2566 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.238790:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2566 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.238797:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726201.238802:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2566 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.238827:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2566 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.238848:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91a11214c900) 00010000:00010000:1.0:1788726201.238851:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726201.238868:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2566 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.238875:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2566 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.301423:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726201.360213:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726201.360412:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914169088 00000100:00100000:0.0:1788726201.360422:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914169088 00000100:00100000:0.0:1788726201.360487:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:0.0:1788726201.360497:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+9:14408:x1875614914169088:12345-192.168.201.42@tcp:101:lctl.0 00010000:00010000:0.0:1788726201.360523:0:15361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726201.360546:0:15361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7000/0xcbde9110e47c256d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a471 expref: -99 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.360613:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6200/0xcbde9110e47c2574 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.360626:0:15361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6200/0xcbde9110e47c2574 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.360638:0:15361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6200/0xcbde9110e47c2574 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726201.360673:0:15361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788726201.360676:0:15361:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788726201.360715:0:15361:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6200/0xcbde9110e47c2574 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.360740:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7000/0xcbde9110e47c256d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a471 expref: 11 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.360771:0:15361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6200/0xcbde9110e47c2574 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a471 expref: 10 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.360779:0:15361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a1132f1000) 00010000:00010000:0.0:1788726201.360782:0:15361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788726201.360785:0:15361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a005fb6200, rc 0) 00000100:00100000:0.0:1788726201.360850:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+10:14408:x1875614914169088:12345-192.168.201.42@tcp:101:lctl.0 Request processed in 354us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726201.360867:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 20 00000100:00100000:2.0:1788726201.402640:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726201.402730:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914169216 00000100:00100000:0.0:1788726201.402740:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914169216 00000100:00100000:0.0:1788726201.402799:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:0.0:1788726201.402810:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:939d2b7f-7fee-4708-b2b7-d0bb2f706947+5:14409:x1875614914169216:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726201.402832:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726201.402889:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7000/0xcbde9110e47c257b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a478 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.402952:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7e00/0xcbde9110e47c2582 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.402966:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7e00/0xcbde9110e47c2582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.402977:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7e00/0xcbde9110e47c2582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726201.403011:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788726201.403026:0:14313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788726201.403173:0:14313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7e00/0xcbde9110e47c2582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.403201:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7000/0xcbde9110e47c257b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a478 expref: 7 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.403265:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7e00/0xcbde9110e47c2582 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a478 expref: 6 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.403274:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a1132f1000) 00010000:00010000:0.0:1788726201.403277:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788726201.403281:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a005fb7e00, rc 0) 00000100:00100000:0.0:1788726201.403891:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:14409:x1875614914169216:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 1080us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726201.403899:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 21 00000100:00100000:3.0:1788726201.406723:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726201.406806:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914169344 00000100:00100000:0.0:1788726201.406816:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914169344 00000100:00100000:0.0:1788726201.406887:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:0.0:1788726201.406896:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:14409:x1875614914169344:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726201.406918:0:15361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726201.406939:0:15361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6000/0xcbde9110e47c2589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a47f expref: -99 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407006:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6a00/0xcbde9110e47c2590 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407020:0:15361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6a00/0xcbde9110e47c2590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407060:0:15361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6a00/0xcbde9110e47c2590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407083:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c2597 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407091:0:15361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c2597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407098:0:15361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c2597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407183:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c259e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407191:0:15361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c259e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407197:0:15361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c259e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726201.407268:0:15361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788726201.407272:0:15361:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788726201.407291:0:15361:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c259e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407304:0:15361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6a00/0xcbde9110e47c2590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407310:0:15361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6a00/0xcbde9110e47c2590 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407327:0:15361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6a00/0xcbde9110e47c2590 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407333:0:15361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a005fb6a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726201.407337:0:15361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6a00/0xcbde9110e47c2590 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407345:0:15361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6a00/0xcbde9110e47c2590 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407357:0:15361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a1132f1000) 00010000:00010000:0.0:1788726201.407361:0:15361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726201.407365:0:15361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6a00/0xcbde9110e47c2590 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407371:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6a00/0xcbde9110e47c2590 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407383:0:15361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c2597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407388:0:15361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c2597 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407393:0:15361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c2597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407398:0:15361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a005fb7c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726201.407400:0:15361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c2597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407416:0:15361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c2597 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407424:0:15361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91a1132f1d00) 00010000:00010000:0.0:1788726201.407426:0:15361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726201.407429:0:15361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c2597 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407435:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c2597 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407464:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6000/0xcbde9110e47c2589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a47f expref: 8 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407477:0:15361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c259e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a47f expref: 7 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.407483:0:15361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a1132f1400) 00010000:00010000:0.0:1788726201.407486:0:15361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788726201.407488:0:15361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a005fb6800, rc 0) 00000100:00100000:0.0:1788726201.407551:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:939d2b7f-7fee-4708-b2b7-d0bb2f706947+7:14409:x1875614914169344:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 656us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726201.407558:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 22 00000100:00100000:1.0:1788726201.413486:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726201.413589:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914169600 00000100:00100000:2.0:1788726201.413600:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914169600 00000100:00100000:2.0:1788726201.413663:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:2.0:1788726201.413673:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+7:14409:x1875614914169600:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726201.413697:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726201.413720:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c25a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a486 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726201.413834:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788726201.413964:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c25a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a486 expref: 9 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.413979:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a1132f1000) 00010000:00010000:2.0:1788726201.413982:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788726201.413987:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c25a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a486 expref: 9 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.414000:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eaa00, rc 0) 00000100:00100000:2.0:1788726201.414063:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+8:14409:x1875614914169600:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 391us (588us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788726201.414071:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 23 00000100:00100000:2.0:1788726201.422651:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726201.423020:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914169856 00000100:00100000:0.0:1788726201.423032:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914169856 00000100:00100000:0.0:1788726201.423107:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:0.0:1788726201.423119:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:939d2b7f-7fee-4708-b2b7-d0bb2f706947+8:14409:x1875614914169856:12345-192.168.201.42@tcp:36:lfs.0 00010000:00010000:0.0:1788726201.423192:0:15361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726201.423256:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c259e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a47f expref: 8 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.423276:0:15361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a1132f1400) 00010000:00010000:0.0:1788726201.423286:0:15361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788726201.423309:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6000/0xcbde9110e47c25b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.423322:0:15361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6000/0xcbde9110e47c25b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.423331:0:15361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6000/0xcbde9110e47c25b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788726201.423545:0:15361:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e19fe695 reply state 00000000c54b7345 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6000/0xcbde9110e47c25b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726201.423555:0:15361:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788726201.423563:0:15361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788726201.423653:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:939d2b7f-7fee-4708-b2b7-d0bb2f706947+9:14409:x1875614914169856:12345-192.168.201.42@tcp:36:lfs.0 Request processed in 536us (1012us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788726201.423661:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 24 00000100:00100000:3.0:1788726201.433306:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726201.433452:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914170112 00000100:00100000:2.0:1788726201.433465:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914170112 00000100:00100000:2.0:1788726201.433524:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:2.0:1788726201.433535:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+9:14409:x1875614914170112:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:2.0:1788726201.433788:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+10:14409:x1875614914170112:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 254us (491us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788726201.433796:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00010000:00010000:0.0:1788726201.433995:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6000/0xcbde9110e47c25b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.434006:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6000/0xcbde9110e47c25b3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.434014:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6000/0xcbde9110e47c25b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.434033:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a005fb6000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726201.434038:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6000/0xcbde9110e47c25b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.434045:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6000/0xcbde9110e47c25b3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.434060:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a1132f1d00) 00010000:00010000:0.0:1788726201.434064:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788726201.434068:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6000/0xcbde9110e47c25b3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.434075:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6000/0xcbde9110e47c25b3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726201.443811:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726201.446489:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914170368 00000100:00100000:2.0:1788726201.446504:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914170368 00000100:00100000:2.0:1788726201.446567:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:2.0:1788726201.446576:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+9:14409:x1875614914170368:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:2.0:1788726201.446632:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726201.446652:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c25ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a48d expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.446724:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.446738:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.446749:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.446763:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.446771:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.446778:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726201.446914:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788726201.447005:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447012:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447019:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447035:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726201.447039:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447319:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447335:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a1132f1000) 00010000:00010000:2.0:1788726201.447338:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726201.447344:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447350:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447365:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447371:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447376:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447382:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ebc00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726201.447390:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447396:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447415:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91a11214cf00) 00010000:00010000:2.0:1788726201.447418:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726201.447420:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447426:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447469:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c25ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a48d expref: 11 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447480:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a1132f1000) 00010000:00010000:2.0:1788726201.447483:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788726201.447486:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c25ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a48d expref: 11 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.447495:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eaa00, rc 0) 00000100:00100000:2.0:1788726201.447568:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+10:14409:x1875614914170368:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 991us (3765us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788726201.447577:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 25 00000100:00100000:3.0:1788726201.454871:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726201.454971:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914170496 00000100:00100000:0.0:1788726201.454983:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914170496 00000100:00100000:0.0:1788726201.455044:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:0.0:1788726201.455064:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:939d2b7f-7fee-4708-b2b7-d0bb2f706947+10:14409:x1875614914170496:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726201.455090:0:15361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726201.455112:0:15361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6000/0xcbde9110e47c25d6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a494 expref: -99 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.455197:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c25dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.455211:0:15361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c25dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.455423:0:15361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c25dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726201.455457:0:15361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788726201.455460:0:15361:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788726201.455477:0:15361:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c25dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.455504:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6000/0xcbde9110e47c25d6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a494 expref: 12 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.455520:0:15361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c25dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a494 expref: 11 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.455529:0:15361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a1132f1d00) 00010000:00010000:0.0:1788726201.455532:0:15361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788726201.455535:0:15361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a005fb6800, rc 0) 00000100:00100000:0.0:1788726201.455590:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:939d2b7f-7fee-4708-b2b7-d0bb2f706947+11:14409:x1875614914170496:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 528us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726201.455597:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 26 00000100:00100000:3.0:1788726201.459181:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726201.459312:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914170624 00000100:00100000:2.0:1788726201.459333:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914170624 00000100:00100000:2.0:1788726201.459386:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:2.0:1788726201.459398:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+11:14409:x1875614914170624:12345-192.168.201.42@tcp:37:lfs.0 00000100:00100000:2.0:1788726201.469689:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+11:14409:x1875614914170624:12345-192.168.201.42@tcp:37:lfs.0 Request processed in 10282us (10507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726201.469702:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 3 00000100:00100000:3.0:1788726201.477758:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726201.477871:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914170880 00000100:00100000:1.0:1788726201.477883:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914170880 00000100:00100000:1.0:1788726201.477944:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:1.0:1788726201.477955:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a006eef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:939d2b7f-7fee-4708-b2b7-d0bb2f706947+11:14409:x1875614914170880:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:1.0:1788726201.478500:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a006eef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:939d2b7f-7fee-4708-b2b7-d0bb2f706947+12:14409:x1875614914170880:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 544us (749us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788726201.478509:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 4 00000100:00100000:1.0:1788726201.549569:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726201.550094:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914171008 00000100:00100000:2.0:1788726201.550106:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914171008 00000100:00100000:2.0:1788726201.550176:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:2.0:1788726201.550187:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+10:14415:x1875614914171008:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:2.0:1788726201.550208:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726201.550258:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c25e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a49b expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550331:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550345:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550356:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550370:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550376:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550381:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550464:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c25f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550471:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c25f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550493:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c25f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726201.550519:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788726201.550522:0:14314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726201.550557:0:14314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c25f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550569:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550575:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550581:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550586:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ebc00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726201.550590:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550598:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550610:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a1132f1000) 00010000:00010000:2.0:1788726201.550613:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726201.550617:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550623:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c25eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550647:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550653:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550950:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550959:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726201.550962:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550968:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550977:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91a11214cf00) 00010000:00010000:2.0:1788726201.550979:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726201.550983:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.550989:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c25f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.551023:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c25e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a49b expref: 12 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.551035:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb600/0xcbde9110e47c25f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a49b expref: 11 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.551064:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a1132f1d00) 00010000:00010000:2.0:1788726201.551066:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788726201.551069:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eb600, rc 0) 00000100:00100000:2.0:1788726201.551134:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+11:14415:x1875614914171008:12345-192.168.201.42@tcp:101:bash.0 Request processed in 948us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726201.551141:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 27 00000100:00100000:0.0:1788726201.555394:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726201.555496:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914171264 00000100:00100000:1.0:1788726201.555507:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914171264 00000100:00100000:1.0:1788726201.555568:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 28 00000100:00100000:1.0:1788726201.555580:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+11:14415:x1875614914171264:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788726201.555600:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726201.555621:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921e00/0xcbde9110e47c2600 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a4a2 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.555766:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2607 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.555782:0:14315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c25dd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a494 expref: 11 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.555790:0:14315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2607 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.555827:0:14315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c25dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a494 expref: 11 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.555840:0:14315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c25dd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a494 expref: 11 pid: 15361 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726201.555866:0:14315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a9f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1875614935132288:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788726201.555960:0:14315:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a110e9e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788726201.562174:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726201.562583:0:14315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a9f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1875614935132288:192.168.201.42@tcp:104: 00010000:00010000:1.0:1788726201.562612:0:14315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2607 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726201.565297:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914171392 00000100:00100000:0.0:1788726201.565312:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914171392 00010000:00010000:0.0:1788726201.565846:0:14300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c25dd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a494 expref: 12 pid: 15361 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726201.566605:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:0.0:1788726201.566618:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:939d2b7f-7fee-4708-b2b7-d0bb2f706947+12:2350:x1875614914171392:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726201.566634:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726201.566656:0:14300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c25dd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a494 expref: 12 pid: 15361 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.566671:0:14300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c25dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a494 expref: 12 pid: 15361 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.566693:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c25dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a494 expref: 12 pid: 15361 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.566710:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a1132f1d00) 00010000:00010000:0.0:1788726201.566715:0:14300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2607 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.566725:0:14300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2607 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.566733:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2607 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.566806:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726201.566893:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:939d2b7f-7fee-4708-b2b7-d0bb2f706947+11:2350:x1875614914171392:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 278us (4727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726201.566900:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00010000:00010000:2.0:1788726201.575043:0:14315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2607 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.575284:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2607 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.575332:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c260e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.575346:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c260e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.575357:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c260e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.576641:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2615 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.576657:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2615 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.576667:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2615 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726201.576694:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788726201.576727:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2607 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.576735:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2607 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.576743:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2607 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.576749:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726201.576754:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2607 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.576761:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2607 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.576774:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a1132f1d00) 00010000:00010000:2.0:1788726201.576777:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726201.576781:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2607 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.576788:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2607 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788726201.576803:0:14315:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9e99fb8 reply state 000000002cc3b290 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c260e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726201.576811:0:14315:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788726201.576862:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921e00/0xcbde9110e47c2600 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4a2 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.576942:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2615 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4a2 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726201.576949:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:2.0:1788726201.576951:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788726201.576954:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eb800, rc 0) 00000100:00100000:2.0:1788726201.577106:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+14:14415:x1875614914171264:12345-192.168.201.42@tcp:101:bash.0 Request processed in 21528us (21720us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788726201.577115:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 28 00010000:00010000:1.0:1788726201.583919:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c260e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.583937:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c260e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.583946:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c260e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.583966:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eaa00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726201.583971:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c260e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.583979:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c260e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.583995:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91a11214cf00) 00010000:00010000:1.0:1788726201.583998:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726201.584002:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c260e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.584008:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eaa00/0xcbde9110e47c260e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726201.595787:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726201.595887:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914171520 00000100:00100000:0.0:1788726201.595898:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914171520 00000100:00100000:0.0:1788726201.595958:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:0.0:1788726201.595968:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+13:14415:x1875614914171520:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788726201.595994:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726201.596014:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2623 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a4a9 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.596103:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c262a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.596117:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c262a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.596128:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c262a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726201.596167:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788726201.596172:0:14313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788726201.596193:0:14313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c262a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.596204:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c262a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.596271:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2623 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4a9 expref: 15 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.596290:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c262a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4a9 expref: 14 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.596299:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726201.596302:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788726201.596304:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a005fb7c00, rc 0) 00000100:00100000:1.0:1788726201.596613:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+14:14415:x1875614914171520:12345-192.168.201.42@tcp:101:bash.0 Request processed in 645us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726201.596621:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 29 00000100:00100000:3.0:1788726201.600636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726201.600913:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914171776 00000100:00100000:2.0:1788726201.600924:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914171776 00000100:00100000:2.0:1788726201.601052:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 5 00000100:00100000:2.0:1788726201.601075:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:459896fe-20ed-424c-974b-8a35340505e4+14:14415:x1875614914171776:12345-192.168.201.42@tcp:35:bash.0 00000100:00100000:2.0:1788726201.601786:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:459896fe-20ed-424c-974b-8a35340505e4+15:14415:x1875614914171776:12345-192.168.201.42@tcp:35:bash.0 Request processed in 721us (1156us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788726201.601795:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 5 00000040:00080000:1.0:1788726201.687024:0:14344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788726201.774916:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726201.777090:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914172032 00000100:00100000:0.0:1788726201.777106:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914172032 00000100:00100000:0.0:1788726201.777186:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:0.0:1788726201.777213:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+15:14425:x1875614914172032:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:0.0:1788726201.777267:0:15361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726201.777287:0:15361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2631 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a4b0 expref: -99 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726201.777393:0:15361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788726201.777507:0:15361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2631 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4b0 expref: 17 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.777523:0:15361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a1132f1000) 00010000:00010000:0.0:1788726201.777526:0:15361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788726201.777532:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2631 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4b0 expref: 17 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.777547:0:15361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a005fb6800, rc 0) 00000100:00100000:0.0:1788726201.777617:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+16:14425:x1875614914172032:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 408us (2712us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788726201.777625:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:3.0:1788726201.787747:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726201.787927:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914172288 00000100:00100000:1.0:1788726201.787938:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914172288 00000100:00100000:1.0:1788726201.788001:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:1.0:1788726201.788013:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+16:14425:x1875614914172288:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:1.0:1788726201.788305:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+17:14425:x1875614914172288:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 294us (568us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788726201.788314:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 6 00000100:00100000:3.0:1788726201.879278:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726201.879516:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914172544 00000100:00100000:1.0:1788726201.879539:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914172544 00000100:00100000:1.0:1788726201.879612:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:1.0:1788726201.879624:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+17:14428:x1875614914172544:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788726201.879650:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726201.879673:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921e00/0xcbde9110e47c263f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a4b7 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.879785:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2646 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.879799:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2646 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.879812:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2646 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726201.879823:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788726201.879955:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921e00/0xcbde9110e47c263f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4b7 expref: 20 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.879974:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2646 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4b7 expref: 19 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.879983:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:1.0:1788726201.879986:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788726201.879990:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920400, rc 0) 00000100:00100000:1.0:1788726201.880051:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+19:14428:x1875614914172544:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 429us (781us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788726201.880067:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:3.0:1788726201.886438:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726201.887155:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914172672 00000100:00100000:0.0:1788726201.887168:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914172672 00000100:00100000:0.0:1788726201.887273:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:0.0:1788726201.887286:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+19:14428:x1875614914172672:12345-192.168.201.42@tcp:54:lfs.0 00000100:00100000:3.0:1788726201.887440:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00010000:00010000:0.0:1788726201.887529:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2654 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726201.887530:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914172800 00000100:00100000:1.0:1788726201.887536:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914172800 00010000:00010000:0.0:1788726201.887550:0:15361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2654 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.887578:0:15361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2654 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726201.887591:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:1.0:1788726201.887601:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:459896fe-20ed-424c-974b-8a35340505e4+20:2352:x1875614914172800:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726201.887606:0:15361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2654 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.887612:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726201.887615:0:15361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2654 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.887624:0:15361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2654 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.891055:0:15361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a005fb6800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:0.0:1788726201.891069:0:15361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2654 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.891345:0:15361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2654 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.891366:0:15361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726201.891369:0:15361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788726201.891374:0:15361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2654 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726201.891382:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2654 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.891599:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c2646 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4b7 expref: 20 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726201.891614:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:1.0:1788726201.891617:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726201.891656:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+19:14428:x1875614914172672:12345-192.168.201.42@tcp:54:lfs.0 Request processed in 4371us (5225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726201.891667:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 32 00000100:00100000:1.0:1788726201.894511:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:459896fe-20ed-424c-974b-8a35340505e4+18:2352:x1875614914172800:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 6897us (7056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726201.894524:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:1.0:1788726201.904869:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726201.904915:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914173056 00000100:00100000:2.0:1788726201.904927:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914173056 00000100:00100000:2.0:1788726201.904999:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:2.0:1788726201.905008:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+18:14428:x1875614914173056:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:2.0:1788726201.905306:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+19:14428:x1875614914173056:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 298us (446us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788726201.905315:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 7 00000100:00100000:3.0:1788726202.235465:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726202.235585:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914173312 00000100:00100000:1.0:1788726202.235596:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914173312 00000100:00100000:1.0:1788726202.235679:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00100000:1.0:1788726202.235690:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+19:14459:x1875614914173312:12345-192.168.201.42@tcp:101:cat.0 00010000:00010000:1.0:1788726202.235722:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726202.235744:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c265b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a4be expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726202.235888:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921e00/0xcbde9110e47c2662 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726202.235903:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921e00/0xcbde9110e47c2662 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726202.235932:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921e00/0xcbde9110e47c2662 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726202.235946:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788726202.236113:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c265b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4be expref: 22 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726202.236132:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921e00/0xcbde9110e47c2662 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4be expref: 21 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726202.236141:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:1.0:1788726202.236144:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788726202.236148:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921e00, rc 0) 00000100:00100000:1.0:1788726202.236263:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+21:14459:x1875614914173312:12345-192.168.201.42@tcp:101:cat.0 Request processed in 525us (761us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788726202.236272:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 33 00000100:00080000:2.0:1788726202.236412:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726202.245331:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726202.245375:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726202.245458:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914173696 00000100:00100000:3.0:1788726202.245470:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914173696 00000100:00100000:3.0:1788726202.245545:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:3.0:1788726202.245557:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459896fe-20ed-424c-974b-8a35340505e4+21:2350:x1875614914173696:12345-192.168.201.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788726202.245569:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914173568 00010000:00010000:3.0:1788726202.245574:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788726202.245574:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914173568 00010000:00010000:3.0:1788726202.245602:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921e00/0xcbde9110e47c2662 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4be expref: 22 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726202.245613:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 8 00000100:00100000:2.0:1788726202.245620:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a1111da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+21:14459:x1875614914173568:12345-192.168.201.42@tcp:35:cat.0 00010000:00010000:3.0:1788726202.245622:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726202.245627:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726202.245683:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459896fe-20ed-424c-974b-8a35340505e4+21:2350:x1875614914173696:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 129us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726202.245690:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 1 00000100:00100000:2.0:1788726202.245965:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a1111da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+21:14459:x1875614914173568:12345-192.168.201.42@tcp:35:cat.0 Request processed in 344us (641us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788726202.245977:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 8 00010000:00010000:3.0:1788726202.327990:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726202.346519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726202.346881:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914173952 00000100:00100000:2.0:1788726202.346892:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914173952 00000100:00100000:2.0:1788726202.346993:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:2.0:1788726202.347005:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+21:14466:x1875614914173952:12345-192.168.201.42@tcp:101:dd.0 00010000:00010000:2.0:1788726202.347031:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726202.347063:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c2670 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a4c5 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726202.347462:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea800/0xcbde9110e47c2677 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726202.347478:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea800/0xcbde9110e47c2677 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726202.347490:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea800/0xcbde9110e47c2677 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726202.347503:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788726202.347665:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c2670 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4c5 expref: 24 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726202.347686:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea800/0xcbde9110e47c2677 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4c5 expref: 23 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726202.347708:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:2.0:1788726202.347711:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726202.347715:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea800, rc 0) 00000100:00100000:2.0:1788726202.347775:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+23:14466:x1875614914173952:12345-192.168.201.42@tcp:101:dd.0 Request processed in 772us (1265us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788726202.347783:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 34 00000100:00100000:3.0:1788726202.351105:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726202.353035:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914174208 00000100:00100000:0.0:1788726202.353059:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914174208 00000100:00100000:0.0:1788726202.353364:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 35 00000100:00100000:0.0:1788726202.353376:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+23:14466:x1875614914174208:12345-192.168.201.42@tcp:36:dd.0 00010000:00010000:0.0:1788726202.353437:0:15361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788726202.353461:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea800/0xcbde9110e47c2677 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4c5 expref: 23 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726202.353480:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7c00/0xcbde9110e47c262a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4a9 expref: 22 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726202.353490:0:15361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726202.353495:0:15361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788726202.353915:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2685 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726202.353929:0:15361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2685 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726202.353939:0:15361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2685 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788726202.353991:0:15361:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788726202.354017:0:15361:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000806161aa reply state 00000000e2a09d15 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2685 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726202.354025:0:15361:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788726202.354295:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+24:14466:x1875614914174208:12345-192.168.201.42@tcp:36:dd.0 Request processed in 920us (3208us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788726202.354421:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 35 00000020:00080000:0.0:1788726202.354428:0:15361:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788726202.360085:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2685 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.360127:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2685 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.360135:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2685 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.360140:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a005fb6800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726202.360145:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2685 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.360153:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2685 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.360171:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726202.360175:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726202.360180:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2685 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.360186:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6800/0xcbde9110e47c2685 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726202.471627:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726202.471986:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914174464 00000100:00100000:2.0:1788726202.471997:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914174464 00000100:00100000:2.0:1788726202.472069:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:2.0:1788726202.472081:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+23:14466:x1875614914174464:12345-192.168.201.42@tcp:35:dd.0 00000100:00100000:2.0:1788726202.472369:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+24:14466:x1875614914174464:12345-192.168.201.42@tcp:35:dd.0 Request processed in 289us (750us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788726202.472377:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 9 00000100:00100000:0.0:1788726202.804733:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726202.804817:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914174592 00000100:00100000:3.0:1788726202.804837:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914174592 00000100:00100000:3.0:1788726202.804901:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:3.0:1788726202.804914:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+24:14480:x1875614914174592:12345-192.168.201.42@tcp:101:stat.0 00010000:00010000:3.0:1788726202.804942:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726202.804964:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c268c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a4cc expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805067:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2693 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805082:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2693 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805095:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2693 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805109:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c269a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805116:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c269a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805123:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c269a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805212:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c26a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805254:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c26a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805260:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c26a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726202.805297:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788726202.805302:0:14313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788726202.805355:0:14313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c26a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805378:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c26a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805386:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2693 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805393:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2693 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805400:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2693 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805406:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d7c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726202.805410:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2693 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805417:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2693 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805429:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a1132f1d00) 00010000:00010000:3.0:1788726202.805432:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726202.805436:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2693 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805442:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2693 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805456:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c269a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805463:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c269a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805475:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c269a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805480:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d6800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726202.805483:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c269a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805490:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c269a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805499:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91a112135800) 00010000:00010000:3.0:1788726202.805501:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726202.805504:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c269a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805509:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c269a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805694:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c268c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4cc expref: 26 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805709:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c26a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4cc expref: 25 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726202.805716:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726202.805718:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726202.805721:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a0050d7a00, rc 0) 00000100:00100000:3.0:1788726202.805792:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+25:14480:x1875614914174592:12345-192.168.201.42@tcp:101:stat.0 Request processed in 880us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726202.805810:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 36 00000100:00100000:1.0:1788726202.880815:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726202.880964:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914174848 00000100:00100000:2.0:1788726202.880975:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914174848 00000100:00100000:2.0:1788726202.881080:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 37 00000100:00100000:2.0:1788726202.881102:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+25:14486:x1875614914174848:12345-192.168.201.42@tcp:36:truncate.0 00010000:00010000:2.0:1788726202.881160:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726202.881189:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c26a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4cc expref: 25 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726202.881207:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:2.0:1788726202.881212:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788726202.881481:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c26a8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726202.881508:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c26a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726202.881518:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c26a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788726202.881906:0:14315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1788726202.881937:0:14315:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000895aa922 reply state 000000000318821d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c26a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726202.881947:0:14315:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788726202.882119:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+27:14486:x1875614914174848:12345-192.168.201.42@tcp:36:truncate.0 Request processed in 1018us (1312us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788726202.882127:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 37 00000020:00080000:2.0:1788726202.882133:0:14315:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788726202.893465:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c26a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726202.893484:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c26a8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726202.893493:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c26a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726202.893499:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ebc00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726202.893504:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c26a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726202.893512:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c26a8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726202.893562:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:2.0:1788726202.893565:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726202.893570:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c26a8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726202.893577:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c26a8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726203.081050:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726203.081191:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914174976 00000100:00100000:3.0:1788726203.081203:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914174976 00000100:00100000:3.0:1788726203.081492:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:3.0:1788726203.081506:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+26:14500:x1875614914174976:12345-192.168.201.42@tcp:101:stat.0 00010000:00010000:3.0:1788726203.081535:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726203.081556:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a4d3 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081625:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c26b6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081641:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c26b6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081657:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c26b6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081672:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c26bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081678:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c26bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081685:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c26bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081789:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6c00/0xcbde9110e47c26c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081818:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6c00/0xcbde9110e47c26c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081837:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6c00/0xcbde9110e47c26c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726203.081886:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1788726203.081890:0:14313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788726203.081909:0:14313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6c00/0xcbde9110e47c26c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081921:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6c00/0xcbde9110e47c26c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081931:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c26b6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081938:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c26b6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081945:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c26b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081951:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d6800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726203.081955:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c26b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081962:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c26b6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081974:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a1132f1d00) 00010000:00010000:3.0:1788726203.081982:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726203.081988:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c26b6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.081995:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c26b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.082010:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c26bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.082016:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c26bd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.082021:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c26bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.082027:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d7c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726203.082030:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c26bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.082035:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c26bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.082043:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91a112135800) 00010000:00010000:3.0:1788726203.082045:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726203.082048:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c26bd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.082053:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c26bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.082084:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26af lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4d3 expref: 28 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.082111:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6c00/0xcbde9110e47c26c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4d3 expref: 27 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.082119:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726203.082122:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726203.082124:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a0050d6c00, rc 0) 00000100:00100000:3.0:1788726203.082199:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+27:14500:x1875614914174976:12345-192.168.201.42@tcp:101:stat.0 Request processed in 696us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726203.082207:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 38 00000100:00100000:1.0:1788726203.161343:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726203.161467:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914175232 00000100:00100000:3.0:1788726203.161477:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914175232 00000100:00100000:3.0:1788726203.161548:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:3.0:1788726203.161563:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+27:14510:x1875614914175232:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:3.0:1788726203.161593:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726203.161616:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a4da expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726203.161717:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788726203.161843:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4da expref: 29 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.161855:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a1132f1000) 00010000:00010000:3.0:1788726203.161857:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788726203.161860:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4da expref: 29 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.161886:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a0050d6000, rc 0) 00000100:00100000:3.0:1788726203.161937:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+28:14510:x1875614914175232:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 377us (605us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1788726203.161943:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 39 00000100:00100000:1.0:1788726203.169819:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726203.170868:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914175488 00000100:00100000:2.0:1788726203.170882:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914175488 00000100:00100000:2.0:1788726203.171077:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:2.0:1788726203.171090:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a006eee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+28:14510:x1875614914175488:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:2.0:1788726203.171360:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a006eee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+29:14510:x1875614914175488:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 273us (1550us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788726203.171368:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:1.0:1788726203.265795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726203.266456:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914175744 00000100:00100000:0.0:1788726203.266469:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914175744 00000100:00100000:0.0:1788726203.266536:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:0.0:1788726203.266547:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+29:14516:x1875614914175744:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:0.0:1788726203.266576:0:15361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726203.266599:0:15361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7a00/0xcbde9110e47c26d9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a4e1 expref: -99 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.266707:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.266722:0:15361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2615 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4a2 expref: 30 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.266730:0:15361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6c00/0xcbde9110e47c26c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4d3 expref: 30 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.266738:0:15361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.266773:0:15361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6c00/0xcbde9110e47c26c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4d3 expref: 30 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.266785:0:15361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6c00/0xcbde9110e47c26c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4d3 expref: 30 pid: 14313 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726203.266815:0:15361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d26680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15361:1875614935132416:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726203.267055:0:15361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2615 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4a2 expref: 30 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.267075:0:15361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2615 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4a2 expref: 30 pid: 14315 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726203.267085:0:15361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d24380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15361:1875614935132544:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726203.267128:0:15361:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13aed0900 going to sleep for 11 seconds 00000100:00100000:1.0:1788726203.279957:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726203.280098:0:15361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d26680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15361:1875614935132416:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726203.280111:0:15361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d24380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15361:1875614935132544:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726203.280150:0:15361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726203.280509:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726203.299366:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914175872 00000100:00100000:2.0:1788726203.299382:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914175872 00010000:00010000:2.0:1788726203.299440:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6c00/0xcbde9110e47c26c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4d3 expref: 31 pid: 14313 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726203.299490:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914176000 00000100:00100000:2.0:1788726203.299494:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914176000 00010000:00010000:2.0:1788726203.299508:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2615 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4a2 expref: 32 pid: 14315 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726203.299525:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:2.0:1788726203.299536:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ae70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:459896fe-20ed-424c-974b-8a35340505e4+32:2349:x1875614914175872:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726203.299568:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726203.299576:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6c00/0xcbde9110e47c26c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4d3 expref: 32 pid: 14313 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.299589:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6c00/0xcbde9110e47c26c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4d3 expref: 32 pid: 14313 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.299625:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6c00/0xcbde9110e47c26c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4d3 expref: 32 pid: 14313 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.299644:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:2.0:1788726203.299650:0:14299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.299659:0:14299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.299665:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726203.299791:0:14298:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788726203.299801:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788726203.300098:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ae70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:459896fe-20ed-424c-974b-8a35340505e4+31:2349:x1875614914175872:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 562us (20149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726203.300106:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:2.0:1788726203.300651:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:2.0:1788726203.300663:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:459896fe-20ed-424c-974b-8a35340505e4+30:2349:x1875614914176000:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726203.300676:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726203.300683:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2615 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4a2 expref: 30 pid: 14315 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.300709:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2615 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4a2 expref: 30 pid: 14315 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.300725:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2615 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4a2 expref: 30 pid: 14315 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.300740:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:2.0:1788726203.300745:0:14299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.300754:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.300761:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.300784:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726203.300818:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:459896fe-20ed-424c-974b-8a35340505e4+29:2349:x1875614914176000:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 159us (20311us total) trans 0 rc 0/0 00010000:00010000:0.0:1788726203.305716:0:15361:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.305734:0:15361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726203.305758:0:15361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788726203.305946:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb7a00/0xcbde9110e47c26d9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4e1 expref: 31 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.305966:0:15361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4e1 expref: 30 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.305989:0:15361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:0.0:1788726203.305992:0:15361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788726203.305996:0:15361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a005fb6c00, rc 0) 00000100:00100000:0.0:1788726203.306059:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+30:14516:x1875614914175744:12345-192.168.201.42@tcp:101:bash.0 Request processed in 39513us (40272us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1788726203.306079:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 40 00000100:00100000:1.0:1788726203.312870:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726203.312953:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914176256 00000100:00100000:3.0:1788726203.312963:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914176256 00000100:00100000:3.0:1788726203.313049:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 41 00000100:00100000:3.0:1788726203.313060:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+30:14516:x1875614914176256:12345-192.168.201.42@tcp:36:bash.0 00010000:00010000:3.0:1788726203.313395:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.313412:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.313429:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788726203.313484:0:14314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1788726203.313508:0:14314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006035c041 reply state 000000009d9c80bf transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726203.313517:0:14314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788726203.313613:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+33:14516:x1875614914176256:12345-192.168.201.42@tcp:36:bash.0 Request processed in 554us (752us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1788726203.313621:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 41 00000020:00080000:3.0:1788726203.313625:0:14314:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788726203.313677:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00010000:00010000:3.0:1788726203.318462:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.318498:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26ee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.318506:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.318511:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d6000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726203.318517:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.318525:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26ee lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.318545:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726203.318549:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726203.318554:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26ee lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.318561:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c26ee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726203.318713:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726203.319727:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914176384 00000100:00100000:3.0:1788726203.319740:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914176384 00000100:00100000:3.0:1788726203.319794:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:3.0:1788726203.319805:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+31:14516:x1875614914176384:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788726203.319843:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726203.319862:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c26f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a4e8 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.319922:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c26f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4e8 expref: 32 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.319947:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c26f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4e8 expref: 32 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.319970:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726203.319973:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788726203.319977:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a0050d7c00, rc 0) 00000100:00100000:3.0:1788726203.320048:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+32:14516:x1875614914176384:12345-192.168.201.42@tcp:101:bash.0 Request processed in 244us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726203.320055:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 42 00000100:00100000:0.0:1788726203.342106:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726203.342267:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914176512 00000100:00100000:1.0:1788726203.342279:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914176512 00000100:00100000:1.0:1788726203.342343:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 43 00000100:00100000:1.0:1788726203.342354:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+32:14516:x1875614914176512:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788726203.342375:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726203.342395:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c26fc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a4ef expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.342491:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c2703 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.342507:0:14315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4e1 expref: 33 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.342517:0:14315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c2703 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.342550:0:14315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4e1 expref: 33 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.342562:0:14315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4e1 expref: 33 pid: 15361 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726203.342577:0:14315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1875614935132672:192.168.201.42@tcp:104: 00000100:00100000:1.0:1788726203.342686:0:14315:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a110e9ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726203.347635:0:14315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1875614935132672:192.168.201.42@tcp:104: 00010000:00010000:2.0:1788726203.347666:0:14315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c2703 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726203.347936:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726203.348427:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914176640 00000100:00100000:1.0:1788726203.348438:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914176640 00010000:00010000:1.0:1788726203.348475:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4e1 expref: 34 pid: 15361 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726203.348536:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:1.0:1788726203.348546:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:459896fe-20ed-424c-974b-8a35340505e4+34:2350:x1875614914176640:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726203.348563:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726203.348571:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4e1 expref: 34 pid: 15361 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.348583:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4e1 expref: 34 pid: 15361 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.348605:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a005fb6c00/0xcbde9110e47c26e0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a4e1 expref: 34 pid: 15361 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.348620:0:14298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:1.0:1788726203.348624:0:14298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c2703 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.348634:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c2703 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.348641:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c2703 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.348677:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726203.348740:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:459896fe-20ed-424c-974b-8a35340505e4+33:2350:x1875614914176640:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 194us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726203.348748:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00010000:00010000:3.0:1788726203.348871:0:14315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c2703 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.348879:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c2703 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726203.348925:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788726203.348930:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788726203.348952:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c2703 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.348985:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c26fc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4ef expref: 33 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.349001:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c2703 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4ef expref: 32 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.349008:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726203.349018:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726203.349021:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920800, rc 0) 00000100:00100000:3.0:1788726203.349063:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+32:14516:x1875614914176512:12345-192.168.201.42@tcp:101:bash.0 Request processed in 6711us (6969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726203.349070:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 43 00010000:00010000:2.0:1788726203.349609:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726203.360314:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726203.360412:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914176896 00000100:00100000:3.0:1788726203.360423:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914176896 00000100:00100000:3.0:1788726203.360489:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:3.0:1788726203.360500:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459896fe-20ed-424c-974b-8a35340505e4+32:14516:x1875614914176896:12345-192.168.201.42@tcp:103:bash.0 00010000:00010000:3.0:1788726203.360514:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788726203.360539:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920800/0xcbde9110e47c2703 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4ef expref: 32 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.360562:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c26f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4e8 expref: 31 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.360572:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cc00) 00010000:00010000:3.0:1788726203.360583:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726203.360635:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459896fe-20ed-424c-974b-8a35340505e4+30:14516:x1875614914176896:12345-192.168.201.42@tcp:103:bash.0 Request processed in 137us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726203.360643:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 2 00000100:00100000:0.0:1788726203.370728:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726203.370847:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914177024 00000100:00100000:2.0:1788726203.370858:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914177024 00000100:00100000:2.0:1788726203.370921:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:2.0:1788726203.370945:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+30:14516:x1875614914177024:12345-192.168.201.42@tcp:58:bash.0 00010000:00010000:2.0:1788726203.371325:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c270a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.371343:0:15361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c270a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.371355:0:15361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c270a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788726203.378682:0:15361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788726203.378876:0:15361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788726203.378946:0:15361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788726203.380863:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+30:14516:x1875614914177024:12345-192.168.201.42@tcp:58:bash.0 Request processed in 9907us (10133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726203.380877:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 44 00000100:00100000:0.0:1788726203.387728:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726203.388277:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914177152 00000100:00100000:3.0:1788726203.388291:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914177152 00000100:00100000:3.0:1788726203.388384:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 45 00000100:00100000:3.0:1788726203.388397:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+30:14516:x1875614914177152:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:3.0:1788726203.388437:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726203.388466:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2711 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a4f6 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.388561:0:14314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c270a lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.388574:0:14314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2711 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4f6 expref: 31 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.388598:0:14314:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c270a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.388613:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2711 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4f6 expref: 31 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.388629:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:3.0:1788726203.388632:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788726203.388636:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2711 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4f6 expref: 31 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.388644:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a0050d7c00, rc 0) 00000100:00100000:3.0:1788726203.388906:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+31:14516:x1875614914177152:12345-192.168.201.42@tcp:101:bash.0 Request processed in 511us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726203.388915:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 45 00000001:00080000:0.0:1788726203.671382:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934616 is committed 00000001:00080000:0.0:1788726203.671402:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:1.0:1788726203.673177:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1788726203.673244:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000040:00080000:1.0:1788726203.735652:0:14344:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788726203.735663:0:14344:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788726203.735704:0:14344:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788726203.735710:0:14344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788726203.735840:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14344:1875614935132800:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788726203.735963:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a112eb6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788726203.745855:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726203.746287:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ab48700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14344:1875614935132800:192.168.201.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788726203.748031:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914177280 00000100:00100000:2.0:1788726203.748045:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914177280 00000100:00100000:2.0:1788726203.748108:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:2.0:1788726203.748120:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:459896fe-20ed-424c-974b-8a35340505e4+10:14517:x1875614914177280:12345-192.168.201.42@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788726203.748211:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:459896fe-20ed-424c-974b-8a35340505e4+10:14517:x1875614914177280:12345-192.168.201.42@tcp:900:lhsmtool_posix.0 Request processed in 93us (2367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726203.748251:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:0.0:1788726203.755092:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726203.755244:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914177408 00000100:00100000:3.0:1788726203.755255:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914177408 00000100:00100000:3.0:1788726203.755315:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:3.0:1788726203.755326:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+10:14517:x1875614914177408:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788726203.755354:0:14313:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788726203.755477:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+10:14517:x1875614914177408:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 152us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726203.755484:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 46 00000100:00100000:1.0:1788726203.762338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726203.762811:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914177536 00000100:00100000:2.0:1788726203.762833:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914177536 00000100:00100000:2.0:1788726203.762891:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:2.0:1788726203.762902:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+10:14517:x1875614914177536:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788726203.762981:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2718 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763012:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2718 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763025:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2718 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763090:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c271f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763098:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c271f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763105:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c271f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763128:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c2726 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763136:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c2726 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763143:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c2726 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726203.763195:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788726203.763199:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726203.763212:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c2726 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763329:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2718 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763346:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2718 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763354:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2718 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763360:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726203.763365:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2718 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763374:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2718 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763388:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a1132f1100) 00010000:00010000:2.0:1788726203.763391:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726203.763456:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2718 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763465:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2718 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763479:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c271f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763486:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c271f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763493:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c271f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763498:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eba00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726203.763508:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c271f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763584:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c271f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763592:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff91a11214cf00) 00010000:00010000:2.0:1788726203.763596:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726203.763599:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c271f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763606:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c271f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763623:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c2726 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763629:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c2726 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763636:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c2726 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763641:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398eb400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726203.763644:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c2726 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763651:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c2726 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763658:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:2.0:1788726203.763660:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726203.763669:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c2726 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.763675:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c2726 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726203.763764:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+10:14517:x1875614914177536:12345-192.168.201.42@tcp:34:lhsmtool_posix.0 Request processed in 862us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726203.763772:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 47 00000100:00100000:0.0:1788726203.784390:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726203.784649:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914177792 00000100:00100000:3.0:1788726203.784659:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914177792 00000100:00100000:3.0:1788726203.784842:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:3.0:1788726203.784855:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+10:14517:x1875614914177792:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726203.784877:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726203.784910:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c272d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a4fd expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.785017:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c2734 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.785047:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c2734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.785059:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c2734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726203.785295:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788726203.785423:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c2734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.785431:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c2734 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.785438:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c2734 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.785443:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d6800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726203.785460:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c2734 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.785468:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c2734 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.785482:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:3.0:1788726203.785485:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788726203.785490:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c2734 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.785497:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c2734 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.785547:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c272d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4fd expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.785558:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91a1132f1100) 00010000:00010000:3.0:1788726203.785560:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788726203.785563:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c272d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4fd expref: 12 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.785573:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a0050d6000, rc 0) 00000100:00100000:3.0:1788726203.785700:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+11:14517:x1875614914177792:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 848us (1319us total) trans 8589934619 rc 301/301 00000100:00100000:3.0:1788726203.785708:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 48 00000100:00100000:0.0:1788726203.792122:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726203.793261:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914177920 00000100:00100000:3.0:1788726203.793278:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914177920 00000100:00100000:3.0:1788726203.793361:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:3.0:1788726203.793373:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+11:14517:x1875614914177920:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788726203.793424:0:14314:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788726203.793553:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+11:14517:x1875614914177920:12345-192.168.201.42@tcp:53:lhsmtool_posix.0 Request processed in 183us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726203.793562:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 49 00000100:00100000:1.0:1788726203.804259:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726203.804514:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914178176 00000100:00100000:2.0:1788726203.804524:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914178176 00000100:00100000:2.0:1788726203.804581:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:2.0:1788726203.804591:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+11:14517:x1875614914178176:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726203.804612:0:15361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726203.804633:0:15361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c2742 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a504 expref: -99 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788726203.805609:0:15361:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:2.0:1788726203.805617:0:15361:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788726203.805665:0:15361:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788726203.807369:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c2749 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.807392:0:15361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c2749 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.807405:0:15361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c2749 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.807482:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c2742 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a504 expref: 14 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.807519:0:15361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c2749 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a504 expref: 13 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.807529:0:15361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a11214cf00) 00010000:00010000:2.0:1788726203.807532:0:15361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726203.807536:0:15361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eba00, rc 0) 00000100:00100000:2.0:1788726203.807667:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+13:14517:x1875614914178176:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 3077us (3459us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788726203.807677:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 50 00000100:00100000:0.0:1788726203.817569:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726203.820826:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914178432 00000100:00100000:3.0:1788726203.820844:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914178432 00000100:00100000:3.0:1788726203.820936:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:3.0:1788726203.820947:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+13:14517:x1875614914178432:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788726203.821008:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726203.821047:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c2749 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a504 expref: 13 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821069:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a11214cf00) 00010000:00010000:3.0:1788726203.821080:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788726203.821104:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c2757 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821116:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c2757 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821124:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c2757 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821191:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c275e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x91aa7866 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821200:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c275e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91aa7866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821281:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c275e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91aa7866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821707:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c2757 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821717:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c2757 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821724:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c2757 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821730:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d6000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726203.821734:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c2757 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821741:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c2757 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821750:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a1132f1d00) 00010000:00010000:3.0:1788726203.821753:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726203.821757:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c2757 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821763:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c2757 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821773:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c275e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91aa7866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821780:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c275e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91aa7866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821794:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c275e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91aa7866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821799:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d6800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726203.821802:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c275e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91aa7866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821810:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c275e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91aa7866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821829:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x91aa7866 (ffff91a112135800) 00010000:00010000:3.0:1788726203.821832:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726203.821835:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c275e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x91aa7866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.821841:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c275e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x91aa7866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726203.822348:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+12:14517:x1875614914178432:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 1399us (4785us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788726203.822358:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 51 00000100:00100000:1.0:1788726203.832003:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726203.832084:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914178560 00000100:00100000:3.0:1788726203.832095:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914178560 00000100:00100000:3.0:1788726203.832164:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:3.0:1788726203.832175:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+12:14517:x1875614914178560:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726203.832200:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726203.832272:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6c00/0xcbde9110e47c2765 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a50b expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.832366:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c276c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.832381:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c276c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.832392:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c276c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.832483:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6c00/0xcbde9110e47c2765 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a50b expref: 14 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.832501:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb400/0xcbde9110e47c276c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a50b expref: 13 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.832509:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a112135900) 00010000:00010000:2.0:1788726203.832729:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788726203.832733:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eb400, rc 0) 00000100:00100000:2.0:1788726203.832810:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+13:14517:x1875614914178560:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 636us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726203.832827:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 52 00000100:00100000:1.0:1788726203.837108:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726203.837358:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914178816 00000100:00100000:2.0:1788726203.837369:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914178816 00000100:00100000:2.0:1788726203.837428:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 53 00000100:00100000:2.0:1788726203.837440:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+13:14517:x1875614914178816:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788726203.837523:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2773 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.837543:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2773 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.837556:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2773 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788726203.838309:0:14315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788726203.838323:0:14315:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 498888107008ns, next at 499888104708ns, rc = 0 00000004:00010000:2.0:1788726203.838434:0:14315:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000636c3e21 reply state 00000000ceac128c transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2773 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726203.838445:0:14315:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788726203.838568:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+15:14517:x1875614914178816:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 1129us (1471us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1788726203.838577:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 53 00010000:00010000:2.0:1788726203.840427:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2773 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.840443:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2773 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.840467:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2773 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.840472:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:2.0:1788726203.840477:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2773 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.840485:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2773 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.840501:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a112135900) 00010000:00010000:2.0:1788726203.840504:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788726203.840509:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2773 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.840518:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2773 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726203.845369:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726203.845434:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914178944 00000100:00100000:2.0:1788726203.845443:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914178944 00000100:00100000:2.0:1788726203.845509:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:2.0:1788726203.845520:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+14:14517:x1875614914178944:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726203.845549:0:15361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726203.845572:0:15361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c277a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a512 expref: -99 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.845633:0:15361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c277a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a512 expref: 15 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.845667:0:15361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c277a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a512 expref: 15 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.845688:0:15361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a112135900) 00010000:00010000:2.0:1788726203.845691:0:15361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788726203.845696:0:15361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eba00, rc 0) 00000100:00100000:2.0:1788726203.845762:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:459896fe-20ed-424c-974b-8a35340505e4+15:14517:x1875614914178944:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 243us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726203.845769:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 54 00000100:00100000:0.0:1788726203.848534:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726203.848649:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914179072 00000100:00100000:3.0:1788726203.848661:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914179072 00000100:00100000:3.0:1788726203.848731:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:3.0:1788726203.848741:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:459896fe-20ed-424c-974b-8a35340505e4+5:2350:x1875614914179072:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788726203.848988:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788726203.849125:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:459896fe-20ed-424c-974b-8a35340505e4+6:2350:x1875614914179072:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 383us (599us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788726203.849133:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 10 00000100:00100000:1.0:1788726203.852702:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726203.853114:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914179328 00000100:00100000:0.0:1788726203.853126:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914179328 00000100:00100000:0.0:1788726203.853185:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:0.0:1788726203.853196:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:459896fe-20ed-424c-974b-8a35340505e4+15:14517:x1875614914179328:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788726203.853479:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:459896fe-20ed-424c-974b-8a35340505e4+16:14517:x1875614914179328:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 285us (789us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788726203.853488:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:1.0:1788726203.856910:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726203.857186:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914179584 00000100:00100000:3.0:1788726203.857196:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914179584 00000100:00100000:2.0:1788726203.857591:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:2.0:1788726203.857606:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ab48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+16:14517:x1875614914179584:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788726203.857730:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ab48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+16:14517:x1875614914179584:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 129us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726203.857739:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 55 00000100:00100000:1.0:1788726203.860626:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726203.860758:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914179712 00000100:00100000:2.0:1788726203.860768:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914179712 00000100:00100000:2.0:1788726203.860832:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:2.0:1788726203.860842:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+16:14517:x1875614914179712:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726203.860860:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726203.860879:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2781 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a519 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.860949:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2788 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.860977:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2788 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.860988:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2788 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726203.861045:0:14314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788726203.861065:0:14314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2788 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.861100:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c2781 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a519 expref: 18 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.861118:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2788 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a519 expref: 17 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.861128:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a112135900) 00010000:00010000:2.0:1788726203.861131:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788726203.861135:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398eb800, rc 0) 00000100:00100000:2.0:1788726203.861202:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+17:14517:x1875614914179712:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 362us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726203.861210:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 56 00000100:00100000:1.0:1788726203.864132:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726203.864537:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914179840 00000100:00100000:2.0:1788726203.864548:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914179840 00000100:00100000:2.0:1788726203.864616:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:2.0:1788726203.864628:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:459896fe-20ed-424c-974b-8a35340505e4+6:2349:x1875614914179840:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726203.864654:0:14995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726203.864693:0:14995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025a1d425/0xcbde9110e47c278f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a520 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788726203.864720:0:14995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9dcbbb, blocks: 0x1 00010000:00010000:2.0:1788726203.864742:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=498s v=(0 0) 00010000:00010000:2.0:1788726203.864746:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726203.864756:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025a1d425/0xcbde9110e47c278f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a520 expref: 7 pid: 14995 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.864776:0:14995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025a1d425/0xcbde9110e47c278f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a520 expref: 7 pid: 14995 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.864789:0:14995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a1398ea800, rc 0) 00000100:00100000:2.0:1788726203.864863:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:459896fe-20ed-424c-974b-8a35340505e4+7:2349:x1875614914179840:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 237us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726203.864871:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 11 00000100:00100000:3.0:1788726203.868338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726203.868443:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914180096 00000100:00100000:2.0:1788726203.868454:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914180096 00000100:00100000:2.0:1788726203.868516:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:2.0:1788726203.868527:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+17:14517:x1875614914180096:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788726203.868645:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+17:14517:x1875614914180096:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 119us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726203.868653:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 57 00000100:00100000:3.0:1788726203.872496:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726203.872882:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914180224 00000100:00100000:1.0:1788726203.872893:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914180224 00000100:00100000:1.0:1788726203.872992:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:1.0:1788726203.873005:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+17:14517:x1875614914180224:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788726203.928792:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1788726203.928829:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788726203.929082:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788726203.929106:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935132928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788726203.929175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726203.929426:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935132928 00000100:00100000:0.0:1788726203.929436:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935132928 00000100:00100000:0.0:1788726203.929507:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788726203.929517:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875614935132928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788726203.929676:0:14996:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788726203.929680:0:14996:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788726203.929682:0:14996:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788726203.929685:0:14996:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788726203 -> 1788726203 00002000:00010000:0.0:1788726203.929688:0:14996:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788726203.929737:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875614935132928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 221us (561us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788726203.929746:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:0.0:1788726203.929788:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91a141d25880/2, rc 0, transno 8589934595 00000100:00100000:0.0:1788726203.929795:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875614935132928:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1788726203.929921:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788726203.930373:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+13:14517:x1875614914180224:12345-192.168.201.42@tcp:44:lhsmtool_posix.0 Request processed in 57368us (57885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726203.930385:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 58 00000100:00100000:3.0:1788726203.933982:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726203.934065:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914180352 00000100:00100000:2.0:1788726203.934085:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914180352 00000100:00100000:2.0:1788726203.934151:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:2.0:1788726203.934161:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:459896fe-20ed-424c-974b-8a35340505e4+7:2349:x1875614914180352:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788726203.935598:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:459896fe-20ed-424c-974b-8a35340505e4+7:2349:x1875614914180352:12345-192.168.201.42@tcp:16:lhsmtool_posix.0 Request processed in 1433us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726203.935611:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:3.0:1788726203.938646:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726203.938933:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914180608 00000100:00100000:1.0:1788726203.938943:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914180608 00000100:00100000:1.0:1788726203.939032:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 59 00000100:00100000:1.0:1788726203.939044:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+13:14517:x1875614914180608:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788726203.939110:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726203.939136:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eb800/0xcbde9110e47c2788 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a519 expref: 13 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.939156:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a112135900) 00010000:00010000:1.0:1788726203.939162:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788726203.939193:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2796 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.939206:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2796 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.939263:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2796 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788726203.939796:0:14314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b02f65cd reply state 00000000d4319b3a transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2796 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726203.939806:0:14314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788726203.939916:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+14:14517:x1875614914180608:12345-192.168.201.42@tcp:36:lhsmtool_posix.0 Request processed in 873us (1280us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788726203.939923:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 59 00010000:00010000:3.0:1788726203.942670:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2796 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.942690:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2796 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.942698:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2796 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.942704:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726203.942709:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2796 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.942732:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2796 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.942750:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a112135900) 00010000:00010000:3.0:1788726203.942753:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726203.942758:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2796 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.942764:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921400/0xcbde9110e47c2796 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726203.945034:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726203.945708:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914180736 00000100:00100000:0.0:1788726203.945720:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914180736 00000100:00100000:0.0:1788726203.945780:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:0.0:1788726203.945790:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:459896fe-20ed-424c-974b-8a35340505e4+7:14517:x1875614914180736:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788726203.945807:0:14996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726203.945835:0:14996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004298ef87/0xcbde9110e47c279d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a527 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.945866:0:14996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025a1d425/0xcbde9110e47c278f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a520 expref: 8 pid: 14995 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.945875:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726203.945879:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726203.945896:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004298ef87/0xcbde9110e47c279d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a527 expref: 8 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.945932:0:14996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025a1d425/0xcbde9110e47c278f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a520 expref: 8 pid: 14995 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.945946:0:14996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025a1d425/0xcbde9110e47c278f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a520 expref: 8 pid: 14995 timeout: 598 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726203.945961:0:14996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d24a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14996:1875614935133056:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726203.946200:0:14996:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13aed0900 going to sleep for 11 seconds 00000100:00100000:1.0:1788726203.949638:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726203.949723:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914180864 00000100:00100000:2.0:1788726203.949733:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914180864 00010000:00010000:2.0:1788726203.949770:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025a1d425/0xcbde9110e47c278f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a520 expref: 9 pid: 14995 timeout: 598 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726203.949808:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:2.0:1788726203.949826:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:459896fe-20ed-424c-974b-8a35340505e4+9:2350:x1875614914180864:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726203.949844:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726203.949865:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025a1d425/0xcbde9110e47c278f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a520 expref: 9 pid: 14995 timeout: 598 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.949879:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025a1d425/0xcbde9110e47c278f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a520 expref: 9 pid: 14995 timeout: 598 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.949903:0:14298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726203.949908:0:14298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726203.949914:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004298ef87/0xcbde9110e47c279d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a527 expref: 9 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.949943:0:14298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004298ef87/0xcbde9110e47c279d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a527 expref: 9 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726203.949980:0:14298:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004298ef87/0xcbde9110e47c279d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a527 expref: 9 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726203.949994:0:14298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a111611180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14298:1875614935133184:192.168.201.42@tcp:105: 00000100:00100000:2.0:1788726203.950092:0:14298:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a12ae09840 going to sleep for 11 seconds 00010000:00010000:0.0:1788726203.951032:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025a1d425/0xcbde9110e47c278f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a520 expref: 9 pid: 14995 timeout: 598 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726203.951053:0:14996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d24a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14996:1875614935133056:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726203.951088:0:14996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004298ef87/0xcbde9110e47c279d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a527 expref: 8 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.951099:0:14996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a005fb6000, rc 0) 00000100:00100000:0.0:1788726203.951149:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:459896fe-20ed-424c-974b-8a35340505e4+8:14517:x1875614914180736:12345-192.168.201.42@tcp:101:lhsmtool_posix.0 Request processed in 5361us (6135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726203.951158:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:1.0:1788726203.957079:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726203.957207:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914180992 00000100:00100000:0.0:1788726203.957252:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914180992 00000100:00100000:0.0:1788726203.957316:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:0.0:1788726203.957343:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:459896fe-20ed-424c-974b-8a35340505e4+8:2349:x1875614914180992:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788726203.957562:0:14997:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788726203.957566:0:14997:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788726203 00002000:00010000:0.0:1788726203.957569:0:14997:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788726201 00002000:00010000:0.0:1788726203.957571:0:14997:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788726203 -> 1788726203 00002000:00010000:0.0:1788726203.957573:0:14997:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788726203.957640:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:459896fe-20ed-424c-974b-8a35340505e4+9:2349:x1875614914180992:12345-192.168.201.42@tcp:2:lhsmtool_posix.0 Request processed in 298us (578us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788726203.957649:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:2.0:1788726203.958459:0:14298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a111611180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14298:1875614935133184:192.168.201.42@tcp:105: 00010000:00010000:2.0:1788726203.958485:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726203.958527:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:459896fe-20ed-424c-974b-8a35340505e4+8:2350:x1875614914180864:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 8701us (8898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726203.958536:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:1.0:1788726203.962672:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726203.962773:0:15759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914181120 00000100:00100000:0.0:1788726203.962784:0:15759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914181120 00000100:00100000:0.0:1788726203.962860:0:15759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:0.0:1788726203.962871:0:15759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:459896fe-20ed-424c-974b-8a35340505e4+8:2351:x1875614914181120:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788726203.962922:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000056194376/0xcbde9110e47c27a4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.962945:0:15759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004298ef87/0xcbde9110e47c279d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.42@tcp remote: 0x228275be9055a527 expref: 8 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.962954:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788726203.962958:0:15759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788726203.962963:0:15759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056194376/0xcbde9110e47c27a4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.963000:0:15759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004298ef87/0xcbde9110e47c279d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a527 expref: 8 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.963198:0:15759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004298ef87/0xcbde9110e47c279d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a527 expref: 8 pid: 14996 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726203.963213:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141d24a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15759:1875614935133312:192.168.201.42@tcp:104: 00000100:00100000:0.0:1788726203.963329:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a13aed0900 going to sleep for 11 seconds 00000100:00100000:3.0:1788726203.966883:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:0.0:1788726203.967346:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141d24a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15759:1875614935133312:192.168.201.42@tcp:104: 00010000:00010000:0.0:1788726203.967373:0:15759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056194376/0xcbde9110e47c27a4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726203.967569:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914181248 00000100:00100000:1.0:1788726203.967577:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914181248 00010000:00010000:1.0:1788726203.967639:0:14300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004298ef87/0xcbde9110e47c279d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a527 expref: 9 pid: 14996 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726203.967675:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:1.0:1788726203.967685:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459896fe-20ed-424c-974b-8a35340505e4+9:2350:x1875614914181248:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726203.967700:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726203.967723:0:14300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004298ef87/0xcbde9110e47c279d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a527 expref: 9 pid: 14996 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.967735:0:14300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004298ef87/0xcbde9110e47c279d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a527 expref: 9 pid: 14996 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.967758:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004298ef87/0xcbde9110e47c279d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.42@tcp remote: 0x228275be9055a527 expref: 9 pid: 14996 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.967774:0:14300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788726203.967778:0:14300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788726203.967784:0:14300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056194376/0xcbde9110e47c27a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.967795:0:14300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056194376/0xcbde9110e47c27a4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.967834:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726203.967892:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459896fe-20ed-424c-974b-8a35340505e4+8:2350:x1875614914181248:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 208us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726203.967908:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00010000:00010000:0.0:1788726203.968757:0:15759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056194376/0xcbde9110e47c27a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.968772:0:15759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056194376/0xcbde9110e47c27a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.968802:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000056194376/0xcbde9110e47c27a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.968824:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056194376/0xcbde9110e47c27a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.968833:0:15759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056194376/0xcbde9110e47c27a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.968854:0:15759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a005fb6a00 already unused, calling callback (ffffffffc142a230) 00010000:00010000:0.0:1788726203.968858:0:15759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056194376/0xcbde9110e47c27a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.968867:0:15759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056194376/0xcbde9110e47c27a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.968882:0:15759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056194376/0xcbde9110e47c27a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726203.968890:0:15759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056194376/0xcbde9110e47c27a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726203.968956:0:15759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:459896fe-20ed-424c-974b-8a35340505e4+7:2351:x1875614914181120:12345-192.168.201.42@tcp:1:lhsmtool_posix.0 Request processed in 6085us (6293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726203.968966:0:15759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:0.0:1788726203.973608:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726203.973686:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914181504 00000100:00100000:3.0:1788726203.973697:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914181504 00000100:00100000:3.0:1788726203.973752:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 60 00000100:00100000:3.0:1788726203.973763:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+13:14517:x1875614914181504:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788726203.973852:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c27ab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.973869:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c27ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.973882:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c27ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.974332:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c27b2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.974345:0:14315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c277a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a512 expref: 14 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.974361:0:14315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c27b2 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.974471:0:14315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c277a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a512 expref: 14 pid: 15361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.974486:0:14315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c277a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a512 expref: 14 pid: 15361 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726203.974502:0:14315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ad50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1875614935133440:192.168.201.42@tcp:104: 00000100:00100000:3.0:1788726203.974629:0:14315:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748240 going to sleep for 11 seconds 00000100:00100000:3.0:1788726203.978926:0:14315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ad50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1875614935133440:192.168.201.42@tcp:104: 00010000:00010000:3.0:1788726203.978956:0:14315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c27b2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726203.979723:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726203.979805:0:16540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914181632 00000100:00100000:1.0:1788726203.979824:0:16540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914181632 00010000:00010000:1.0:1788726203.979864:0:16540:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c277a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a512 expref: 15 pid: 15361 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726203.979906:0:16540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:1.0:1788726203.979916:0:16540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:459896fe-20ed-424c-974b-8a35340505e4+15:2350:x1875614914181632:12345-192.168.201.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726203.979931:0:16540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726203.979938:0:16540:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c277a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a512 expref: 15 pid: 15361 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.979950:0:16540:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c277a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a512 expref: 15 pid: 15361 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.979972:0:16540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398eba00/0xcbde9110e47c277a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.42@tcp remote: 0x228275be9055a512 expref: 15 pid: 15361 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.979991:0:16540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a112135900) 00010000:00010000:1.0:1788726203.979996:0:16540:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c27b2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.980006:0:16540:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c27b2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.980014:0:16540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c27b2 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.980081:0:16540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726203.980133:0:16540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:459896fe-20ed-424c-974b-8a35340505e4+14:2350:x1875614914181632:12345-192.168.201.42@tcp:103:ldlm_bl.0 Request processed in 218us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726203.980142:0:16540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00010000:00010000:3.0:1788726203.980431:0:14315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c27b2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.980440:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c27b2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788726203.980636:0:14315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1788726203.980784:0:14315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1788726203.980844:0:14315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1788726203.980928:0:14315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ad50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14315:1875614935133568:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788726203.981030:0:14315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726203.981065:0:14315:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748000 going to sleep for 11 seconds 00000100:00100000:0.0:1788726203.981257:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935133568 00000100:00100000:0.0:1788726203.981265:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935133568 00000100:00100000:0.0:1788726203.981310:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788726203.981318:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14315:x1875614935133568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788726203.981388:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14315:x1875614935133568:12345-0@lo:1000:mdt00_002.0 Request processed in 71us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726203.981406:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788726203.981976:0:14315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ad50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14315:1875614935133568:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788726203.982688:0:14315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1788726203.982756:0:14315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13ad50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14315:1875614935133696:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788726203.982805:0:14315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726203.982849:0:14315:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748240 going to sleep for 11 seconds 00000100:00100000:0.0:1788726203.983174:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935133696 00000100:00100000:0.0:1788726203.983181:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935133696 00000100:00100000:0.0:1788726203.983246:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788726203.983255:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13ad51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14315:x1875614935133696:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788726203.983432:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13ad51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14315:x1875614935133696:12345-0@lo:1000:mdt00_002.0 Request processed in 178us (626us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788726203.983440:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788726203.983943:0:14315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13ad50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14315:1875614935133696:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788726203.983980:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c27b2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.983991:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c27b2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.984000:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c27b2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.984006:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d6000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726203.984012:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c27b2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.984019:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c27b2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.984037:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a112135900) 00010000:00010000:3.0:1788726203.984040:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788726203.984046:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c27b2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.984052:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6000/0xcbde9110e47c27b2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.984861:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c270a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.984887:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c270a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.984895:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c270a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.984900:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ebc00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726203.984904:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c270a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.984911:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c270a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.984922:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:3.0:1788726203.984924:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788726203.984932:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2711 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4f6 expref: 17 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.984943:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2711 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4f6 expref: 17 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.984952:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2711 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4f6 expref: 17 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.984992:0:14315:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7c00/0xcbde9110e47c2711 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a4f6 expref: 17 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726203.985009:0:14315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1875614935133824:192.168.201.42@tcp:105: 00000100:00100000:3.0:1788726203.985676:0:14315:0:(client.c:2715:ptlrpc_set_wait()) set ffff91a111748240 going to sleep for 11 seconds 00000100:00100000:0.0:1788726203.990915:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726203.991014:0:14315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1875614935133824:192.168.201.42@tcp:105: 00010000:00010000:3.0:1788726203.991053:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c270a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991064:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ebc00/0xcbde9110e47c270a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 15361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991108:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c27b9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991122:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c27b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991135:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c27b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991144:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c27b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991150:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c27b9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991157:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c27b9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991162:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d7a00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726203.991166:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c27b9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991173:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c27b9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991202:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:3.0:1788726203.991205:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726203.991209:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c27b9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991244:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d7a00/0xcbde9110e47c27b9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991256:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c27ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991263:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c27ab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991269:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c27ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991274:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a0050d6800 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:3.0:1788726203.991278:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c27ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991284:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c27ab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991292:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:3.0:1788726203.991294:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788726203.991297:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c27ab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726203.991303:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a0050d6800/0xcbde9110e47c27ab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726203.991664:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+17:14517:x1875614914181504:12345-192.168.201.42@tcp:57:lhsmtool_posix.0 Request processed in 17901us (18064us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1788726203.991675:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 60 00000020:00080000:3.0:1788726203.991681:0:14315:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788726203.991864:0:14344:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788726203.991868:0:14344:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788726203.991892:0:14344:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788726203.991898:0:14344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788726203.992369:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914181760 00000100:00100000:1.0:1788726203.992377:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914181760 00000100:00100000:1.0:1788726203.992434:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:1.0:1788726203.992444:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:459896fe-20ed-424c-974b-8a35340505e4+17:14516:x1875614914181760:12345-192.168.201.42@tcp:49:bash.0 00000100:00100000:1.0:1788726203.992546:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:459896fe-20ed-424c-974b-8a35340505e4+17:14516:x1875614914181760:12345-192.168.201.42@tcp:49:bash.0 Request processed in 103us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726203.992553:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 12 00000100:00100000:0.0:1788726203.997269:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726203.997790:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914181888 00000100:00100000:1.0:1788726203.997801:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914181888 00000100:00100000:1.0:1788726203.997871:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:1.0:1788726203.997881:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:459896fe-20ed-424c-974b-8a35340505e4+7:14516:x1875614914181888:12345-192.168.201.42@tcp:101:bash.0 00010000:00010000:1.0:1788726203.997900:0:14997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726203.997921:0:14997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c27c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a52e expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788726203.997948:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9dcbbb, atime: 0x6a9dcbb9, ctime: 0x6a9dcbbb, blocks: 0x1 00010000:00010000:1.0:1788726203.997970:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1788726203.997974:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726203.997984:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c27c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a52e expref: 8 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.998033:0:14997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008bf51c36/0xcbde9110e47c27c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a52e expref: 8 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726203.998048:0:14997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108921600, rc 0) 00000100:00100000:1.0:1788726203.998113:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:459896fe-20ed-424c-974b-8a35340505e4+8:14516:x1875614914181888:12345-192.168.201.42@tcp:101:bash.0 Request processed in 233us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726203.998121:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 17 00000100:00100000:3.0:1788726204.002443:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726204.002503:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726204.002649:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914182144 00000100:00100000:2.0:1788726204.002661:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914182144 00000100:00100000:2.0:1788726204.002719:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914182400 00000100:00100000:2.0:1788726204.002723:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914182400 00000100:00100000:2.0:1788726204.002739:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:2.0:1788726204.002749:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+18:14516:x1875614914182144:12345-192.168.201.42@tcp:35:bash.0 00000001:00080000:2.0:1788726204.003014:0:14316:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000001:00080000:2.0:1788726204.003148:0:14316:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:2.0:1788726204.003290:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+21:14516:x1875614914182144:12345-192.168.201.42@tcp:35:bash.0 Request processed in 542us (857us total) trans 8589934631 rc 0/0 00000100:00100000:2.0:1788726204.003298:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000020:00080000:2.0:1788726204.003302:0:14316:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788726204.003319:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:2.0:1788726204.003327:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+20:14517:x1875614914182400:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788726204.003845:0:14316:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788726204.003967:0:14316:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00010000:00010000:2.0:1788726204.004008:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c27c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726204.004026:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c27c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726204.004037:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c27c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726204.004046:0:14316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c27c7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726204.004052:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c27c7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726204.004057:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c27c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726204.004080:0:14316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788726204.004129:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+22:14517:x1875614914182400:12345-192.168.201.42@tcp:35:lhsmtool_posix.0 Request processed in 801us (1624us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1788726204.004146:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000020:00080000:2.0:1788726204.004150:0:14316:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788726204.004176:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726204.004181:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c27c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726204.004188:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a1398ea400 already unused, calling callback (ffffffffc142a230) 00010000:00010000:2.0:1788726204.004193:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c27c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726204.004200:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c27c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726204.004212:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91a112135900) 00010000:00010000:2.0:1788726204.004240:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788726204.004245:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c27c7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726204.004251:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a1398ea400/0xcbde9110e47c27c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726204.004263:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726204.004264:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726204.004266:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788726204.005365:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726204.116337:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726204.116449:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914182656 00000100:00100000:1.0:1788726204.116460:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914182656 00000100:00100000:1.0:1788726204.116525:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:1.0:1788726204.116537:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+22:14527:x1875614914182656:12345-192.168.201.42@tcp:101:lfs.0 00010000:00010000:1.0:1788726204.116568:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726204.116589:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c27ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x228275be9055a535 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726204.116692:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788726204.116784:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c27ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a535 expref: 24 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.116796:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91a1132f1000) 00010000:00010000:1.0:1788726204.116799:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788726204.116802:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c27ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.42@tcp remote: 0x228275be9055a535 expref: 24 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.116850:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a108920c00, rc 0) 00000100:00100000:1.0:1788726204.120674:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:459896fe-20ed-424c-974b-8a35340505e4+23:14527:x1875614914182656:12345-192.168.201.42@tcp:101:lfs.0 Request processed in 4123us (4329us total) trans 8589934634 rc 301/301 00000100:00100000:1.0:1788726204.120689:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 61 00000100:00100000:0.0:1788726204.127837:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726204.128744:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914182784 00000100:00100000:1.0:1788726204.128759:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914182784 00000100:00100000:1.0:1788726204.128870:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:1.0:1788726204.128883:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+23:14527:x1875614914182784:12345-192.168.201.42@tcp:34:lfs.0 00010000:00010000:1.0:1788726204.128965:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c27dc lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.128983:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c27dc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.128995:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c27dc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.129012:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c27e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.129019:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c27e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.129026:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c27e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.129285:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c27ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.129294:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c27ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.129302:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c27ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788726204.129984:0:14313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c27ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130000:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c27dc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130006:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c27dc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130013:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c27dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130579:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920c00 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726204.130586:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c27dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130595:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c27dc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130612:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91a1132f1d00) 00010000:00010000:1.0:1788726204.130615:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726204.130620:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c27dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130627:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920c00/0xcbde9110e47c27dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130639:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c27e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130646:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c27e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130661:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c27e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130667:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108921000 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726204.130670:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c27e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130677:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c27e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130686:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91a10d14d200) 00010000:00010000:1.0:1788726204.130688:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726204.130691:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c27e3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130697:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108921000/0xcbde9110e47c27e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130714:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c27ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130720:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c27ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130725:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c27ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130730:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a108920400 already unused, calling callback (ffffffffc1e4a4f0) 00010000:00010000:1.0:1788726204.130733:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c27ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130750:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c27ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130759:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91a11214cd00) 00010000:00010000:1.0:1788726204.130761:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726204.130765:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c27ea lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726204.130770:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a108920400/0xcbde9110e47c27ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726204.130991:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:459896fe-20ed-424c-974b-8a35340505e4+23:14527:x1875614914182784:12345-192.168.201.42@tcp:34:lfs.0 Request processed in 2106us (3161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726204.131003:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 62 00000100:00100000:1.0:1788726204.138210:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:2.0:1788726204.138980:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914183040 00000100:00100000:2.0:1788726204.138991:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914183040 00000100:00100000:2.0:1788726204.139099:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:2.0:1788726204.139111:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+23:14527:x1875614914183040:12345-192.168.201.42@tcp:35:lfs.0 00000100:00100000:2.0:1788726204.139370:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:459896fe-20ed-424c-974b-8a35340505e4+24:14527:x1875614914183040:12345-192.168.201.42@tcp:35:lfs.0 Request processed in 261us (1170us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788726204.139406:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00010000:00010000:2.0:1788726204.377417:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726205.141678:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a141da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935133952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788726205.141746:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726205.141836:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935133952 00000100:00100000:0.0:1788726205.141844:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935133952 00000100:00100000:0.0:1788726205.141913:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788726205.141925:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875614935133952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788726205.141962:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788726205.142008:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875614935133952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726205.142016:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788726205.142037:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788726205.142086:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a141da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875614935133952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788726205.142422:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935134080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788726205.142452:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726205.142529:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935134080 00000100:00100000:3.0:1788726205.142534:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935134080 00000100:00100000:3.0:1788726205.142575:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788726205.142583:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a141da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935134080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788726205.142603:0:14998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788726205.142640:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a141da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875614935134080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726205.142647:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788726205.142785:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788726205.142834:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875614935134080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788726205.145773:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788726205.151212:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935134336:0@lo:400:kworker.0 00000100:00100000:1.0:1788726205.151316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726205.151368:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3305:1875614935134208:0@lo:400:kworker.0 00000100:00100000:1.0:1788726205.151397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726205.152249:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935134336 00000100:00100000:2.0:1788726205.152260:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935134336 00000100:00100000:2.0:1788726205.152316:0:15361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788726205.152327:0:15361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13b17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935134336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726205.152392:0:15361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13b17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875614935134336:12345-0@lo:400:kworker.0 Request processed in 67us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726205.152398:0:15361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788726205.152422:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935134208 00000100:00100000:2.0:1788726205.152426:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935134208 00000100:00100000:2.0:1788726205.152453:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788726205.152459:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c02b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:3305:x1875614935134208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726205.152487:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c02b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76a859c7-cdbc-4bb3-9a70-48c81e8748a1+19:3305:x1875614935134208:12345-0@lo:400:kworker.0 Request processed in 29us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726205.152494:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788726205.152544:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875614935134336:0@lo:400:kworker.0 00000100:00100000:2.0:1788726205.152553:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76a859c7-cdbc-4bb3-9a70-48c81e8748a1:3305:1875614935134208:0@lo:400:kworker.0 00000100:00100000:3.0:1788726205.152838:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935134464:0@lo:400:kworker.0 00000100:00100000:2.0:1788726205.153350:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91a13a45ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935134592:0@lo:400:kworker.0 00000100:00100000:3.0:1788726205.153808:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726205.153976:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935134464 00000100:00100000:2.0:1788726205.153984:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935134464 00000100:00100000:2.0:1788726205.154065:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788726205.154075:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935134464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726205.154129:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875614935134464:12345-0@lo:400:kworker.0 Request processed in 56us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726205.154143:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788726205.154165:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726205.154193:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614935134592 00000100:00100000:2.0:1788726205.154197:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614935134592 00000100:00100000:2.0:1788726205.154244:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788726205.154251:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a111611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935134592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726205.154285:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a111611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875614935134592:12345-0@lo:400:kworker.0 Request processed in 35us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726205.154292:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788726205.154325:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875614935134464:0@lo:400:kworker.0 00000100:00100000:2.0:1788726205.154359:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91a13a45ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875614935134592:0@lo:400:kworker.0 00000100:00080000:3.0:1788726205.154473:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788726205.397468:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788726205.768810:0:16579:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1788726205.869491:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726205.869527:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726205.869551:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726205.869571:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726205.869590:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726205.869608:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726205.869634:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726205.869662:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914183168 00000100:00100000:3.0:1788726205.869678:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914183168 00000100:00100000:3.0:1788726205.869729:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:3.0:1788726205.869740:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13c02bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:2349:x1875614914183168:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726205.869845:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13c02bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab7e8877-a281-4332-b6fb-e13d74566ae9+13:2349:x1875614914183168:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 107us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726205.869854:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 123 00000100:00100000:3.0:1788726205.869888:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914183424 00000100:00100000:3.0:1788726205.869892:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914183424 00000100:00100000:3.0:1788726205.869918:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914183552 00000100:00100000:3.0:1788726205.869921:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914183552 00000100:00100000:3.0:1788726205.869933:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914183808 00000100:00100000:3.0:1788726205.869935:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914183808 00000100:00100000:3.0:1788726205.869946:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914183936 00000100:00100000:3.0:1788726205.869948:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914183936 00000100:00100000:3.0:1788726205.869963:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:3.0:1788726205.869970:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:459896fe-20ed-424c-974b-8a35340505e4+8:2349:x1875614914183424:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726205.869998:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:459896fe-20ed-424c-974b-8a35340505e4+8:2349:x1875614914183424:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 28us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726205.870005:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 13 00000100:00100000:3.0:1788726205.870016:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:3.0:1788726205.870022:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:459896fe-20ed-424c-974b-8a35340505e4+5:2350:x1875614914183552:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726205.870045:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:459896fe-20ed-424c-974b-8a35340505e4+5:2350:x1875614914183552:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 24us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726205.870052:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 14 00000100:00100000:3.0:1788726205.870061:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:3.0:1788726205.870066:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+5:2350:x1875614914183808:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726205.870101:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+5:2350:x1875614914183808:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 33us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726205.870107:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 15 00000100:00100000:3.0:1788726205.870119:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:3.0:1788726205.870125:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+5:2349:x1875614914183936:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726205.870165:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:939d2b7f-7fee-4708-b2b7-d0bb2f706947+5:2349:x1875614914183936:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 39us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726205.870171:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 16 00000100:00100000:3.0:1788726205.870192:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914183680 00000100:00100000:3.0:1788726205.870195:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914183680 00000100:00100000:3.0:1788726205.870244:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914183296 00000100:00100000:3.0:1788726205.870247:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914183296 00000100:00100000:3.0:1788726205.870267:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:3.0:1788726205.870273:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:2349:x1875614914183680:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726205.870305:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:939d2b7f-7fee-4708-b2b7-d0bb2f706947+6:2349:x1875614914183680:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 32us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726205.870312:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 30 00000100:00100000:3.0:1788726205.870324:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00100000:3.0:1788726205.870330:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+24:2350:x1875614914183296:12345-192.168.201.42@tcp:400:kworker.0 00000100:00100000:3.0:1788726205.870356:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:459896fe-20ed-424c-974b-8a35340505e4+24:2350:x1875614914183296:12345-192.168.201.42@tcp:400:kworker.0 Request processed in 26us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726205.870362:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 31 00000100:00080000:3.0:1788726205.870522:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788726205.870527:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788726205.870529:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788726206.038415:0:14344:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788726206.038425:0:14344:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788726206.038458:0:14344:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788726206.038464:0:14344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788726206.423025:0:14301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788726207.303068:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1788726207.303090:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000100:00100000:3.0:1788726207.400455:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:3.0:1788726207.400516:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.42@tcp (source: 12345-192.168.201.42@tcp) 00000100:00100000:1.0:1788726207.403014:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914184064 00000100:00100000:1.0:1788726207.403034:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914184064 00002000:00100000:1.0:1788726207.403118:0:15000:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff91a13a45c000 x1875614914184064/t0(0) o4->459896fe-20ed-424c-974b-8a35340505e4@192.168.201.42@tcp:603/0 lens 504/0 e 0 to 0 dl 1788726218 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788726207.403144:0:15000:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13a45c000 with x1875614914184064 ext(0->8) 00002000:00010000:1.0:1788726207.403151:0:15000:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a13a45c000 00000100:00100000:1.0:1788726207.403187:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 0 00000100:00100000:1.0:1788726207.403198:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:459896fe-20ed-424c-974b-8a35340505e4+6:2349:x1875614914184064:12345-192.168.201.42@tcp:4:bash.0 00000100:00100000:1.0:1788726207.403815:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a13a45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:459896fe-20ed-424c-974b-8a35340505e4+8:2349:x1875614914184064:12345-192.168.201.42@tcp:4:bash.0 Request processed in 614us (3293us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788726207.403826:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.42@tcp, seq: 0 00002000:00100000:1.0:1788726207.403835:0:15000:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff91a13a45c000 x1875614914184064/t8589934598(0) o4->459896fe-20ed-424c-974b-8a35340505e4@192.168.201.42@tcp:603/0 lens 504/448 e 0 to 0 dl 1788726218 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788726207.403845:0:15000:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91a13a45c000 with x1875614914184064 ext(0->8) 00002000:00010000:1.0:1788726207.403848:0:15000:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91a13a45c000 00000100:00080000:2.0:1788726207.404065:0:14309:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788726207.407805:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614914184192 00000100:00100000:0.0:1788726207.407827:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614914184192 00000100:00100000:0.0:1788726207.407930:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.42@tcp, seq: 18 00000100:00100000:0.0:1788726207.407943:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a13a45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:459896fe-20ed-424c-974b-8a35340505e4+8:2349:x1875614914184192:12345-192.168.201.42@tcp:16:kworker.0 00010000:00010000:2.0:1788726207.451834:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29752 lines, 29752 kept, 0 dropped, 0 bad.